| *** fragatina has joined #openstack-operators | 00:00 | |
| *** fragatina has quit IRC | 00:00 | |
| *** fragatina has joined #openstack-operators | 00:01 | |
| *** mriedem has quit IRC | 00:04 | |
| *** armax has quit IRC | 00:06 | |
| *** ducttape_ has joined #openstack-operators | 00:30 | |
| *** negronjl has joined #openstack-operators | 00:31 | |
| *** negronjl has quit IRC | 00:31 | |
| *** negronjl has joined #openstack-operators | 00:35 | |
| mrhillsman | raginbajin | 00:40 |
|---|---|---|
| *** sticker has joined #openstack-operators | 00:40 | |
| *** ducttape_ has quit IRC | 00:42 | |
| *** zioproto has joined #openstack-operators | 00:42 | |
| *** zioproto has quit IRC | 00:48 | |
| *** ducttape_ has joined #openstack-operators | 01:12 | |
| *** ducttape_ has quit IRC | 01:52 | |
| *** VW has joined #openstack-operators | 01:58 | |
| *** catintheroof has joined #openstack-operators | 01:58 | |
| *** catintheroof has quit IRC | 02:06 | |
| *** ircuser-1 has joined #openstack-operators | 02:38 | |
| *** fragatina has quit IRC | 02:52 | |
| *** fragatina has joined #openstack-operators | 02:53 | |
| *** VW has quit IRC | 02:53 | |
| *** VW has joined #openstack-operators | 02:57 | |
| *** VW has quit IRC | 03:01 | |
| *** VW has joined #openstack-operators | 03:03 | |
| *** VW has quit IRC | 03:05 | |
| *** VW has joined #openstack-operators | 03:06 | |
| *** VW has quit IRC | 03:22 | |
| *** udesale has joined #openstack-operators | 03:30 | |
| *** ducttape_ has joined #openstack-operators | 03:36 | |
| *** ducttape_ has quit IRC | 03:55 | |
| *** fragatin_ has joined #openstack-operators | 04:04 | |
| *** fragatina has quit IRC | 04:05 | |
| *** b_rake has joined #openstack-operators | 04:08 | |
| *** ducttape_ has joined #openstack-operators | 04:14 | |
| *** sudipto has joined #openstack-operators | 04:17 | |
| *** udesale has quit IRC | 04:18 | |
| *** udesale has joined #openstack-operators | 04:18 | |
| *** udesale_ has joined #openstack-operators | 04:18 | |
| *** udesale_ has quit IRC | 04:18 | |
| *** udesale has quit IRC | 04:18 | |
| *** udesale has joined #openstack-operators | 04:19 | |
| *** sudipto has quit IRC | 04:38 | |
| *** ducttape_ has quit IRC | 04:41 | |
| *** b_rake has quit IRC | 04:54 | |
| *** b_rake has joined #openstack-operators | 04:55 | |
| *** armax has joined #openstack-operators | 04:58 | |
| *** b_rake has quit IRC | 04:59 | |
| *** armax has quit IRC | 04:59 | |
| *** simon-AS559 has quit IRC | 05:00 | |
| *** simon-AS559 has joined #openstack-operators | 05:06 | |
| *** VW has joined #openstack-operators | 05:22 | |
| *** b_rake has joined #openstack-operators | 05:23 | |
| *** saneax-_-|AFK is now known as saneax | 05:26 | |
| *** VW has quit IRC | 05:27 | |
| *** twiggy has joined #openstack-operators | 05:34 | |
| *** b_rake has quit IRC | 05:34 | |
| *** b_rake has joined #openstack-operators | 05:35 | |
| *** b_rake has quit IRC | 05:39 | |
| *** b_rake has joined #openstack-operators | 05:44 | |
| *** sudipto has joined #openstack-operators | 05:47 | |
| *** sudipto has quit IRC | 05:48 | |
| *** mgagne has quit IRC | 05:53 | |
| *** mgagne has joined #openstack-operators | 05:55 | |
| *** mgagne is now known as Guest51737 | 05:55 | |
| *** b_rake has quit IRC | 06:10 | |
| *** b_rake has joined #openstack-operators | 06:10 | |
| *** b_rake has quit IRC | 06:14 | |
| *** udesale has quit IRC | 06:36 | |
| *** udesale has joined #openstack-operators | 06:38 | |
| *** rcernin has quit IRC | 06:39 | |
| *** ducttape_ has joined #openstack-operators | 06:41 | |
| *** slaweq_ has quit IRC | 06:44 | |
| *** ducttape_ has quit IRC | 06:47 | |
| *** mfisch has quit IRC | 06:49 | |
| *** slaweq_ has joined #openstack-operators | 06:49 | |
| *** homegrown_ has joined #openstack-operators | 06:52 | |
| *** mfisch has joined #openstack-operators | 06:52 | |
| *** mfisch has quit IRC | 06:53 | |
| *** mfisch has joined #openstack-operators | 06:53 | |
| *** homegrown has quit IRC | 06:53 | |
| *** simon-AS559 has quit IRC | 06:53 | |
| *** vinsh has joined #openstack-operators | 06:53 | |
| *** vinsh_ has quit IRC | 06:56 | |
| *** dewanee has quit IRC | 06:57 | |
| *** fragatin_ has quit IRC | 07:18 | |
| *** Oku_OS-away is now known as Oku_OS | 07:18 | |
| *** sudipto has joined #openstack-operators | 07:21 | |
| *** sudipto_ has joined #openstack-operators | 07:21 | |
| *** beddari has quit IRC | 07:26 | |
| *** simon-AS559 has joined #openstack-operators | 07:26 | |
| *** rcernin has joined #openstack-operators | 07:28 | |
| *** rcernin has quit IRC | 07:29 | |
| *** rcernin has joined #openstack-operators | 07:32 | |
| *** jamesdenton has quit IRC | 07:48 | |
| *** jamesdenton has joined #openstack-operators | 07:50 | |
| *** d0ugal has joined #openstack-operators | 07:51 | |
| *** rcernin has quit IRC | 07:52 | |
| *** rcernin has joined #openstack-operators | 07:59 | |
| *** rcernin has quit IRC | 08:01 | |
| *** rcernin has joined #openstack-operators | 08:03 | |
| *** dmanchad is now known as dmanchad|brno | 08:10 | |
| *** beddari has joined #openstack-operators | 08:12 | |
| *** paramite has joined #openstack-operators | 08:20 | |
| *** bvandenh has joined #openstack-operators | 08:33 | |
| *** ducttape_ has joined #openstack-operators | 08:43 | |
| *** ducttape_ has quit IRC | 08:48 | |
| *** zioproto has joined #openstack-operators | 09:00 | |
| *** markd_ has quit IRC | 09:20 | |
| *** fragatina has joined #openstack-operators | 09:38 | |
| *** dbecker has joined #openstack-operators | 09:52 | |
| *** mattjarvis has joined #openstack-operators | 09:57 | |
| *** simon-AS5591 has joined #openstack-operators | 10:03 | |
| *** simon-AS559 has quit IRC | 10:05 | |
| *** electrofelix has joined #openstack-operators | 10:11 | |
| *** derekh has joined #openstack-operators | 10:12 | |
| *** matrohon has joined #openstack-operators | 10:16 | |
| *** rmart04 has joined #openstack-operators | 10:16 | |
| *** fragatina has quit IRC | 10:20 | |
| *** simon-AS559 has joined #openstack-operators | 10:24 | |
| *** simon-AS5591 has quit IRC | 10:27 | |
| *** mattjarvis has left #openstack-operators | 10:27 | |
| *** khappone has quit IRC | 10:30 | |
| *** rlaurika has quit IRC | 10:33 | |
| *** rlaurika has joined #openstack-operators | 10:33 | |
| *** khappone has joined #openstack-operators | 10:33 | |
| *** mdavidson has joined #openstack-operators | 10:39 | |
| *** ducttape_ has joined #openstack-operators | 10:44 | |
| *** ducttape_ has quit IRC | 10:49 | |
| *** tesseract has joined #openstack-operators | 11:05 | |
| *** tesseract is now known as Guest17259 | 11:05 | |
| *** udesale has quit IRC | 11:15 | |
| *** Guest17259 has quit IRC | 11:21 | |
| *** tesseract- has joined #openstack-operators | 11:24 | |
| *** simon-AS5591 has joined #openstack-operators | 11:44 | |
| *** simon-AS559 has quit IRC | 11:44 | |
| *** sudipto has quit IRC | 12:04 | |
| *** sudipto_ has quit IRC | 12:04 | |
| *** derekh has quit IRC | 12:11 | |
| *** derekh has joined #openstack-operators | 12:16 | |
| *** VW has joined #openstack-operators | 12:23 | |
| *** VW has quit IRC | 12:27 | |
| *** slaweq_ has quit IRC | 12:31 | |
| *** racedo has joined #openstack-operators | 12:32 | |
| *** racedo has quit IRC | 12:40 | |
| *** ducttape_ has joined #openstack-operators | 12:45 | |
| *** ducttape_ has quit IRC | 12:49 | |
| *** racedo has joined #openstack-operators | 12:55 | |
| *** jamesdenton has quit IRC | 12:59 | |
| *** simon-AS559 has joined #openstack-operators | 13:01 | |
| *** zioproto1 has joined #openstack-operators | 13:03 | |
| *** simon-AS5591 has quit IRC | 13:03 | |
| *** zioproto has quit IRC | 13:04 | |
| *** zioproto has joined #openstack-operators | 13:06 | |
| *** zioproto1 has quit IRC | 13:08 | |
| *** ducttape_ has joined #openstack-operators | 13:08 | |
| *** racedo has quit IRC | 13:26 | |
| *** tesseract- has quit IRC | 13:27 | |
| *** liverpooler has joined #openstack-operators | 13:32 | |
| *** catintheroof has joined #openstack-operators | 13:38 | |
| *** VW has joined #openstack-operators | 13:40 | |
| *** VW has quit IRC | 13:41 | |
| *** ducttape_ has quit IRC | 13:46 | |
| *** VW has joined #openstack-operators | 13:50 | |
| *** karad has joined #openstack-operators | 13:54 | |
| *** karad has quit IRC | 13:54 | |
| *** karad has joined #openstack-operators | 13:55 | |
| *** liverpooler has quit IRC | 13:55 | |
| *** liverpooler has joined #openstack-operators | 13:55 | |
| *** racedo has joined #openstack-operators | 13:57 | |
| *** VW has quit IRC | 13:57 | |
| *** VW has joined #openstack-operators | 13:57 | |
| *** zioproto has quit IRC | 13:59 | |
| *** cdelatte has joined #openstack-operators | 14:00 | |
| *** zioproto has joined #openstack-operators | 14:02 | |
| *** catinthe_ has joined #openstack-operators | 14:02 | |
| *** zioproto has quit IRC | 14:03 | |
| *** catintheroof has quit IRC | 14:04 | |
| *** VW has quit IRC | 14:08 | |
| *** dminer has joined #openstack-operators | 14:11 | |
| *** fragatina has joined #openstack-operators | 14:21 | |
| *** sudipto_ has joined #openstack-operators | 14:25 | |
| *** sudipto has joined #openstack-operators | 14:25 | |
| *** jamesdenton has joined #openstack-operators | 14:26 | |
| *** nicodemus_ has joined #openstack-operators | 14:33 | |
| *** racedo has quit IRC | 14:34 | |
| *** racedo has joined #openstack-operators | 14:35 | |
| nicodemus_ | hello | 14:36 |
| nicodemus_ | I'm writing a doc about the relationship between the concepts of region, domains, project, and roles and realized I have a fundamental doubt, perhaps someone could shed so light to it | 14:37 |
| nicodemus_ | as per the following 2-region architecture: http://docs.openstack.org/arch-design/multi-site-architecture.html | 14:37 |
| *** udesale has joined #openstack-operators | 14:38 | |
| *** ducttape_ has joined #openstack-operators | 14:38 | |
| nicodemus_ | If I have a single Keystone servicing both regions, does each region has its own domains/project/users? Or are domains/project/users common to both domains? | 14:38 |
| nicodemus_ | And, if the domains/project/users are shared, how does a user choose which region he or she wants to log in and use? Does he or she have to specify through Horizon to which region login? | 14:39 |
| *** ducttape_ has quit IRC | 14:53 | |
| *** simon-AS5591 has joined #openstack-operators | 14:56 | |
| *** simon-AS5591 has quit IRC | 14:57 | |
| *** simon-AS5591 has joined #openstack-operators | 14:57 | |
| *** simon-AS5591 has quit IRC | 14:59 | |
| *** simon-AS5591 has joined #openstack-operators | 14:59 | |
| *** simon-AS559 has quit IRC | 15:00 | |
| *** simon-AS5591 has quit IRC | 15:00 | |
| *** simon-AS559 has joined #openstack-operators | 15:01 | |
| *** VW has joined #openstack-operators | 15:04 | |
| *** liverpooler has quit IRC | 15:04 | |
| *** simon-AS559 has quit IRC | 15:06 | |
| *** simon-AS559 has joined #openstack-operators | 15:06 | |
| *** twiggy has quit IRC | 15:07 | |
| *** fragatina has quit IRC | 15:08 | |
| *** fragatina has joined #openstack-operators | 15:08 | |
| *** mriedem has joined #openstack-operators | 15:14 | |
| *** saneax is now known as saneax-_-|AFK | 15:17 | |
| *** bsilverman_ has quit IRC | 15:21 | |
| *** ducttape_ has joined #openstack-operators | 15:23 | |
| *** bsilverman_ has joined #openstack-operators | 15:24 | |
| *** liverpooler has joined #openstack-operators | 15:29 | |
| *** karad has quit IRC | 15:30 | |
| *** ducttape_ has quit IRC | 15:33 | |
| *** fragatina has quit IRC | 15:38 | |
| *** ducttape_ has joined #openstack-operators | 15:39 | |
| *** ckonstanski has quit IRC | 15:39 | |
| *** fragatina has joined #openstack-operators | 15:42 | |
| *** ducttape_ has quit IRC | 15:42 | |
| *** ducttape_ has joined #openstack-operators | 15:53 | |
| *** armax has joined #openstack-operators | 15:55 | |
| *** mperazol has joined #openstack-operators | 15:55 | |
| *** _ducttape_ has joined #openstack-operators | 15:58 | |
| *** paramite_ has joined #openstack-operators | 15:59 | |
| *** karad has joined #openstack-operators | 15:59 | |
| *** paramite_ has quit IRC | 15:59 | |
| *** ducttape_ has quit IRC | 16:02 | |
| *** ckonstanski has joined #openstack-operators | 16:04 | |
| *** rcernin has quit IRC | 16:05 | |
| *** paramite has quit IRC | 16:13 | |
| *** catintheroof has joined #openstack-operators | 16:13 | |
| *** fragatina has quit IRC | 16:14 | |
| *** catinthe_ has quit IRC | 16:16 | |
| *** zioproto has joined #openstack-operators | 16:17 | |
| *** bdeschenes has joined #openstack-operators | 16:26 | |
| *** rmart04 has quit IRC | 16:29 | |
| *** slaweq_ has joined #openstack-operators | 16:33 | |
| *** bdeschenes has quit IRC | 16:35 | |
| *** erhudy has joined #openstack-operators | 16:36 | |
| erhudy | anyone using openstack-ansible to deploy clusters that are on routed racks? i.e. no L2 spanning | 16:37 |
| logan- | erhudy: o/ ... we've chatted before but that's what I am doing. OSA deploys a calico routed cloud for my env. | 16:45 |
| *** zioproto has quit IRC | 16:45 | |
| erhudy | ah good | 16:52 |
| erhudy | essentially the same thing we'd be doing | 16:52 |
| *** karad has quit IRC | 16:58 | |
| erhudy | are you using it to deploy ceph as well, or all local storage? | 16:59 |
| logan- | ceph for all cinder storage, primarily ceph for nova ephemeral, but also some local storage flavors mixed in | 17:00 |
| *** catinthe_ has joined #openstack-operators | 17:02 | |
| erhudy | our old in-house deployment stuff is about to reach its expiration date and we have a chance to move over to OSA or something else starting with our new hardware deploys next year | 17:03 |
| *** catintheroof has quit IRC | 17:04 | |
| *** b_rake has joined #openstack-operators | 17:05 | |
| *** d0ugal has quit IRC | 17:07 | |
| *** slaweq_ has quit IRC | 17:07 | |
| *** slaweq_ has joined #openstack-operators | 17:08 | |
| *** udesale has quit IRC | 17:08 | |
| *** _ducttape_ has quit IRC | 17:11 | |
| *** ducttape_ has joined #openstack-operators | 17:11 | |
| *** _ducttape_ has joined #openstack-operators | 17:14 | |
| logan- | gotcha. I really enjoy working with OSA as an op. I started deploying this setup in Kilo and for Newton I upstreamed my calico deployment stuff for OSA, so that's built in now. If you have any questions getting up and running let me know. | 17:14 |
| *** ducttape_ has quit IRC | 17:15 | |
| *** slaweq_ has quit IRC | 17:16 | |
| *** slaweq_ has joined #openstack-operators | 17:18 | |
| *** matrohon has quit IRC | 17:19 | |
| *** ducttape_ has joined #openstack-operators | 17:26 | |
| *** Guest51737 is now known as mgagne | 17:26 | |
| *** mgagne has quit IRC | 17:27 | |
| *** mgagne has joined #openstack-operators | 17:27 | |
| *** _ducttape_ has quit IRC | 17:28 | |
| erhudy | dangerous offer | 17:29 |
| *** dbecker has quit IRC | 17:31 | |
| *** fragatina has joined #openstack-operators | 17:36 | |
| *** kstev has joined #openstack-operators | 17:42 | |
| logan- | lol | 17:43 |
| *** fragatina has quit IRC | 17:45 | |
| erhudy | i haven't had time to play with OSA at all yet, i need to at least get AIO working on my linux machine at home first | 17:46 |
| *** harlowja has joined #openstack-operators | 17:50 | |
| *** Rockyg has joined #openstack-operators | 17:52 | |
| *** sudipto_ has quit IRC | 17:54 | |
| *** sudipto has quit IRC | 17:54 | |
| *** ducttape_ has quit IRC | 17:54 | |
| *** ducttape_ has joined #openstack-operators | 17:55 | |
| *** derekh has quit IRC | 17:59 | |
| *** sudipto_ has joined #openstack-operators | 18:00 | |
| *** sudipto has joined #openstack-operators | 18:00 | |
| *** Apoorva has joined #openstack-operators | 18:01 | |
| *** vinsh has quit IRC | 18:02 | |
| *** vinsh has joined #openstack-operators | 18:02 | |
| *** mriedem has quit IRC | 18:02 | |
| *** sudipto has quit IRC | 18:03 | |
| *** sudipto_ has quit IRC | 18:03 | |
| *** vinsh_ has joined #openstack-operators | 18:06 | |
| *** electrofelix has quit IRC | 18:07 | |
| *** ckonstanski has quit IRC | 18:08 | |
| *** vinsh has quit IRC | 18:10 | |
| *** kstev has quit IRC | 18:13 | |
| *** piet has joined #openstack-operators | 18:14 | |
| *** fragatina has joined #openstack-operators | 18:15 | |
| *** karad has joined #openstack-operators | 18:17 | |
| *** ducttape_ has quit IRC | 18:17 | |
| *** simon-AS559 has quit IRC | 18:17 | |
| jproulx | anyone know what q-agent-notifier-tunnel-update_fanout queue is used for and why only half of mine have consumers and the other half seem to be just stacking messages? (presumably it's a openvswitch-agent thing but restarting all the agents and the message queue & keeps splitting like this currently about 2k queued messages no one's consuming after about 60min) | 18:21 |
| erhudy | i have issues with cinder orphaning queues like that under certain conditions, and then they keep filling up forever because the queue never gets unbound at the exchange | 18:22 |
| erhudy | someday i'll understand how the consumers find those queues named with hashes, but it is not this day | 18:23 |
| erhudy | if it goes an hour without anything consuming it i usually unbind it manually and delete the queue on the assumption it's been forgotten | 18:24 |
| *** karad has quit IRC | 18:25 | |
| jproulx | it's like the agents on the hypervisors and the consumers on the network node are calculating those hashes differently or something. | 18:26 |
| * jproulx goes to check for version drift... | 18:26 | |
| erhudy | yeah, it mainly happened to me when upgrading kilo stuff to liberty | 18:27 |
| jproulx | I've been on mitaka for a bout 2 months (hopefully all the same minor release) | 18:27 |
| * jproulx shrugs | 18:27 | |
| erhudy | it's also happened if rabbit nodes were restarting and the HA got disrupted a bit during the node restarts | 18:29 |
| *** karad has joined #openstack-operators | 18:30 | |
| *** maishsk has joined #openstack-operators | 18:31 | |
| jproulx | just single rabbitmq-server so presumably it's in sync with itself.... | 18:33 |
| *** karad has quit IRC | 18:34 | |
| *** maishsk has quit IRC | 18:37 | |
| *** maishsk has joined #openstack-operators | 18:39 | |
| *** ducttape_ has joined #openstack-operators | 18:51 | |
| *** fragatina has quit IRC | 18:52 | |
| *** fragatina has joined #openstack-operators | 18:52 | |
| *** d0ugal has joined #openstack-operators | 18:54 | |
| *** VW_ has joined #openstack-operators | 18:56 | |
| *** maishsk has quit IRC | 18:56 | |
| *** VW_ has quit IRC | 18:56 | |
| *** VW_ has joined #openstack-operators | 18:57 | |
| *** VW_ has quit IRC | 18:59 | |
| *** VW has quit IRC | 18:59 | |
| *** VW__ has joined #openstack-operators | 18:59 | |
| *** maishsk has joined #openstack-operators | 18:59 | |
| *** karad has joined #openstack-operators | 18:59 | |
| *** VW__ has quit IRC | 19:00 | |
| *** VW has joined #openstack-operators | 19:00 | |
| *** emagana has joined #openstack-operators | 19:01 | |
| *** jamesdenton has quit IRC | 19:07 | |
| *** jamesdenton has joined #openstack-operators | 19:09 | |
| *** j^2_ has joined #openstack-operators | 19:20 | |
| *** khappone_ has joined #openstack-operators | 19:21 | |
| *** matt6434 has joined #openstack-operators | 19:22 | |
| *** baffle_ has joined #openstack-operators | 19:23 | |
| *** VW has quit IRC | 19:23 | |
| *** VW has joined #openstack-operators | 19:24 | |
| *** bapalm_ has joined #openstack-operators | 19:26 | |
| *** khappone has quit IRC | 19:28 | |
| *** noama has quit IRC | 19:28 | |
| *** bapalm has quit IRC | 19:28 | |
| *** j^2 has quit IRC | 19:28 | |
| *** mattoliverau has quit IRC | 19:28 | |
| *** baffle has quit IRC | 19:28 | |
| *** mrhillsman has quit IRC | 19:28 | |
| *** jroll has quit IRC | 19:28 | |
| *** j^2_ is now known as j^2 | 19:29 | |
| yankcrime | jproulx: i've seen this behaviour as well - we've had queues like that with > 200k messages and no consumers | 19:30 |
| *** Apoorva has quit IRC | 19:30 | |
| yankcrime | never really got to the bottom of it, in most cases it's not caused a problem per se | 19:30 |
| *** Apoorva has joined #openstack-operators | 19:31 | |
| jproulx | looks like I'll have to dig through some code to see wtf...if I kill the queues they just come back and start refilling | 19:32 |
| yankcrime | hmm | 19:34 |
| yankcrime | even with no consumers? | 19:35 |
| *** noama has joined #openstack-operators | 19:35 | |
| *** VW has quit IRC | 19:35 | |
| *** fragatina has quit IRC | 19:35 | |
| yankcrime | be interested to hear what you find! | 19:35 |
| *** jroll has joined #openstack-operators | 19:36 | |
| *** VW has joined #openstack-operators | 19:37 | |
| *** codebauss has joined #openstack-operators | 19:38 | |
| *** codebauss is now known as mrhillsman | 19:38 | |
| *** shamail_ has joined #openstack-operators | 19:39 | |
| *** shamail_ has quit IRC | 19:40 | |
| *** shamail has joined #openstack-operators | 19:41 | |
| *** dbecker has joined #openstack-operators | 19:42 | |
| *** fragatina has joined #openstack-operators | 19:42 | |
| *** shamail has quit IRC | 19:55 | |
| *** VW has quit IRC | 19:58 | |
| *** twiggy has joined #openstack-operators | 20:02 | |
| *** VW has joined #openstack-operators | 20:02 | |
| *** fragatina has quit IRC | 20:03 | |
| *** mriedem has joined #openstack-operators | 20:03 | |
| *** fragatina has joined #openstack-operators | 20:05 | |
| erhudy | jproulx: did you unbind the queue from the exchange before deleting it | 20:08 |
| erhudy | if the binding is still present rabbit will recreate the queue and keep on dumping messages into it | 20:09 |
| jproulx | erhudy though I did but ... worth double checking | 20:11 |
| erhudy | if something is recreating the binding as well then perhaps an exorcism is in order | 20:12 |
| jproulx | wouldn't be the first time | 20:12 |
| *** slaweq_ has quit IRC | 20:19 | |
| *** slaweq_ has joined #openstack-operators | 20:21 | |
| *** fragatina has quit IRC | 20:24 | |
| *** fragatina has joined #openstack-operators | 20:24 | |
| *** fragatina has quit IRC | 20:25 | |
| *** racedo has quit IRC | 20:29 | |
| *** fragatina has joined #openstack-operators | 20:29 | |
| *** fragatina has quit IRC | 20:29 | |
| *** dfflanders has joined #openstack-operators | 20:32 | |
| *** d0ugal has quit IRC | 20:32 | |
| *** simon-AS559 has joined #openstack-operators | 20:35 | |
| *** maishsk has quit IRC | 20:36 | |
| *** VW has quit IRC | 20:38 | |
| *** VW has joined #openstack-operators | 20:39 | |
| *** fragatina has joined #openstack-operators | 20:41 | |
| *** nicodemus_ has quit IRC | 20:42 | |
| *** vinsh_ has quit IRC | 20:44 | |
| *** vinsh has joined #openstack-operators | 20:44 | |
| *** fragatina has quit IRC | 20:46 | |
| *** vinsh_ has joined #openstack-operators | 20:49 | |
| *** jamesdenton has quit IRC | 20:52 | |
| *** vinsh has quit IRC | 20:53 | |
| *** catinthe_ has quit IRC | 20:53 | |
| *** slaweq_ has quit IRC | 20:56 | |
| *** slaweq_ has joined #openstack-operators | 20:58 | |
| *** vinsh_ has quit IRC | 21:02 | |
| *** VW has quit IRC | 21:03 | |
| jproulx | OK yeah the hash values may change but new queues get created and published to and no one consumes from them (unclear if the ones with consumers are getting messages as individual message rate is slow so always 0.00/sec) | 21:03 |
| *** cdelatte has quit IRC | 21:07 | |
| *** VW has joined #openstack-operators | 21:10 | |
| *** rebase_ has joined #openstack-operators | 21:12 | |
| *** twiggy has quit IRC | 21:13 | |
| *** emagana has quit IRC | 21:19 | |
| *** VW has quit IRC | 21:31 | |
| *** VW has joined #openstack-operators | 21:32 | |
| *** matt6434 is now known as mattoliverau | 21:34 | |
| *** emagana has joined #openstack-operators | 21:36 | |
| *** catintheroof has joined #openstack-operators | 21:39 | |
| *** mriedem has quit IRC | 21:57 | |
| yankcrime | erhudy: any notes / advice on the best way to do that? (unbinding queues etc.) | 22:00 |
| erhudy | i just do it manually as needed, though if i ever find myself with free time someday i would like to work something up to determine it from the API | 22:01 |
| erhudy | find queues that are just accumulating messages forever and at least notify a human | 22:01 |
| *** VW has quit IRC | 22:01 | |
| *** VW has joined #openstack-operators | 22:04 | |
| *** VW has quit IRC | 22:04 | |
| *** VW has joined #openstack-operators | 22:05 | |
| jproulx | I'd been thrashing around with 'rabbitmqadmin' and a bunch of grepping and cutting to find queues with zero consumers and >0 items, seems most of my fanouts had fantoms that would ghost back after a round of 'rabbitmqadmin delete binding' and 'rabbitmqadmin delete queue' | 22:10 |
| jproulx | my bets are currently on the fact I was running out of DB connections, after upping that things seem to at least not be getting weird as quickly :) | 22:11 |
| jproulx | only 8 of about 2k queues have no consumers but none of those have any messages either so... | 22:12 |
| *** fragatina has joined #openstack-operators | 22:14 | |
| *** liverpooler has quit IRC | 22:20 | |
| *** fragatina has quit IRC | 22:23 | |
| yankcrime | thanks, i need to do some cleanup as well so i'll see how i fare over the next week or so | 22:24 |
| yankcrime | glad to know it's not just us ;) | 22:25 |
| jproulx | nope, (though that was an issue), seems all the q_agent fanouts just multiplied themselves and I have about 500 new queues all at once, sigh....none of which have consumers and each of which seem to be very slowly collecting messages | 22:26 |
| *** VW_ has joined #openstack-operators | 22:26 | |
| jproulx | number of queues also growing up to 600 now :) Though my really problem was the DB this queue multiplication may have been happening for ever and I just never noticed... | 22:27 |
| * jproulx goes home hoping his cloud doesn't catch fire | 22:28 | |
| *** fragatina has joined #openstack-operators | 22:29 | |
| *** VW has quit IRC | 22:30 | |
| *** VW_ has quit IRC | 22:31 | |
| *** mperazol has quit IRC | 22:35 | |
| *** VW has joined #openstack-operators | 22:37 | |
| *** simon-AS559 has quit IRC | 22:38 | |
| *** rcernin has joined #openstack-operators | 22:40 | |
| *** VW has quit IRC | 22:41 | |
| *** emagana has quit IRC | 22:47 | |
| erhudy | i have definitely found that DB issues can manifest in rabbit in strange ways | 22:55 |
| *** piet has quit IRC | 23:00 | |
| *** fragatin_ has joined #openstack-operators | 23:05 | |
| *** fragatina has quit IRC | 23:08 | |
| *** VW has joined #openstack-operators | 23:10 | |
| *** VW has quit IRC | 23:15 | |
| *** dminer has quit IRC | 23:20 | |
| *** _ducttape_ has joined #openstack-operators | 23:20 | |
| *** ducttape_ has quit IRC | 23:23 | |
| *** _ducttape_ has quit IRC | 23:25 | |
| *** dminer has joined #openstack-operators | 23:38 | |
| *** dminer has quit IRC | 23:42 | |
| *** benj_ has quit IRC | 23:43 | |
| *** benj_ has joined #openstack-operators | 23:44 | |
| *** mriedem has joined #openstack-operators | 23:45 | |
| *** VW has joined #openstack-operators | 23:52 | |
| *** VW has quit IRC | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!