| *** rossk has quit IRC | 00:23 | |
| *** rektide has quit IRC | 00:57 | |
| *** jraim has quit IRC | 00:57 | |
| *** jraim has joined #openstack-marconi | 00:58 | |
| *** openstack has joined #openstack-marconi | 01:05 | |
| *** russell_h has joined #openstack-marconi | 01:05 | |
| *** seiflotfy_ has joined #openstack-marconi | 01:19 | |
| *** oz_akan_ has joined #openstack-marconi | 01:23 | |
| *** reed has quit IRC | 01:30 | |
| *** nosnos has joined #openstack-marconi | 01:39 | |
| *** flwang has quit IRC | 02:42 | |
| *** haomaiwang has quit IRC | 02:51 | |
| *** haomaiwa_ has joined #openstack-marconi | 02:51 | |
| *** haomaiwa_ has quit IRC | 03:05 | |
| *** flwang has joined #openstack-marconi | 03:15 | |
| *** rwsu has quit IRC | 03:19 | |
| *** haomaiwang has joined #openstack-marconi | 03:20 | |
| *** haomaiwang has quit IRC | 03:36 | |
| *** haomaiwang has joined #openstack-marconi | 03:37 | |
| *** reed has joined #openstack-marconi | 03:37 | |
| *** haomaiw__ has joined #openstack-marconi | 03:40 | |
| *** haomaiwang has quit IRC | 03:43 | |
| *** rwsu has joined #openstack-marconi | 03:50 | |
| *** fifieldt has joined #openstack-marconi | 03:51 | |
| *** oz_akan_ has quit IRC | 04:15 | |
| *** sld_ is now known as sld | 04:16 | |
| *** oz_akan_ has joined #openstack-marconi | 04:18 | |
| *** oz_akan_ has quit IRC | 04:23 | |
| *** reed has quit IRC | 05:32 | |
| *** sld has left #openstack-marconi | 06:20 | |
| *** saju_m has joined #openstack-marconi | 06:52 | |
| *** flaper87|afk is now known as flaper87 | 07:24 | |
| *** jamieh has joined #openstack-marconi | 08:16 | |
| *** jamieh is now known as Guest8106 | 08:16 | |
| *** saju_m has quit IRC | 08:41 | |
| *** ekarlso has quit IRC | 08:47 | |
| *** ekarlso has joined #openstack-marconi | 08:47 | |
| openstackgerrit | Fengqian Gao proposed a change to openstack/marconi: Keep python 3.X compatibility for xrange https://review.openstack.org/79879 | 08:52 |
|---|---|---|
| *** saju_m has joined #openstack-marconi | 09:09 | |
| *** flwang has quit IRC | 09:14 | |
| *** anamalagon_ has joined #openstack-marconi | 09:16 | |
| *** anamalagon has quit IRC | 09:19 | |
| *** tmu has quit IRC | 09:48 | |
| *** tmu has joined #openstack-marconi | 09:49 | |
| *** flwang has joined #openstack-marconi | 10:06 | |
| *** amarsharma has joined #openstack-marconi | 10:28 | |
| amarsharma | Hey people I am new here can anybody help to setup Openstack or provide resources to help me? | 10:34 |
| *** saju_m has quit IRC | 10:49 | |
| flaper87 | amarsharma: o/ | 10:50 |
| flaper87 | welcome to the most amazing channel in the whole IRC world | 10:50 |
| flaper87 | so, the easiest way to install marconi is: | 10:50 |
| flaper87 | $ git clone $MARCONI_REPO | 10:50 |
| flaper87 | $ cd marconi/ && pip install -e . | 10:50 |
| flaper87 | that will setup marconi (you should use a virtualenv) | 10:50 |
| flaper87 | once the pip install command ends, you just run | 10:51 |
| flaper87 | $ marconi-server -d -v | 10:51 |
| flaper87 | amarsharma: brb in a bit, hope that helps | 10:51 |
| amarsharma | Hi Flavio thanks for help I am having some issues with my PC :/ I'll try and ask if it works :) | 11:05 |
| *** ChanServ changes topic to "test/gate jobs are queuing now in preparation for gerrit maintenance at 12:00 utc (eta to resume is 12:30 utc)" | 11:27 | |
| *** amarsharma has left #openstack-marconi | 11:36 | |
| *** fifieldt has quit IRC | 11:42 | |
| *** ykaplan has joined #openstack-marconi | 11:44 | |
| *** amarsharma has joined #openstack-marconi | 11:55 | |
| *** mwagner_lap has quit IRC | 11:59 | |
| amarsharma | Ok Flavio I'll try running in a virtual machine :) | 12:10 |
| flaper87 | amarsharma: awesome, are you using linux or windows? | 12:11 |
| amarsharma | I have a dual boot setup plus VMware installed in windows | 12:11 |
| amarsharma | Hey can I independently run marconi without whole openstack installed.. | 12:13 |
| amarsharma | I mean if I just install marconi with Mangodb I am good to go right ? | 12:15 |
| *** oz_akan_ has joined #openstack-marconi | 12:16 | |
| flaper87 | amarsharma: sure, marconi is integrated with other openstack services but it's a stand-alone service, nontheless. | 12:16 |
| amarsharma | Ok thanks :) | 12:17 |
| openstackgerrit | Sascha Peilicke proposed a change to openstack/marconi: Fix config file name in README instructions https://review.openstack.org/79922 | 12:21 |
| amarsharma | Actually I am a GSOC aspirant and interested in Marconi Project I am trying to get around with Marconi code and currently seeing the bug tracker webpage of it :) | 12:22 |
| *** ChanServ changes topic to "gerrit on review.openstack.org is down for maintenance (revised eta to resume is 13:00 utc)" | 12:24 | |
| *** ykaplan has quit IRC | 12:37 | |
| *** saju_m has joined #openstack-marconi | 12:37 | |
| *** oz_akan_ has quit IRC | 12:45 | |
| openstackgerrit | Sascha Peilicke proposed a change to openstack/marconi: Fix functional config file instructions. https://review.openstack.org/79925 | 12:48 |
| openstackgerrit | Sascha Peilicke proposed a change to openstack/marconi: Rename logging.conf-sample to logging.conf.sample https://review.openstack.org/79926 | 12:48 |
| *** amarsharma has quit IRC | 12:50 | |
| *** sriram has joined #openstack-marconi | 12:53 | |
| *** sriram has quit IRC | 12:53 | |
| *** oz_akan_ has joined #openstack-marconi | 12:53 | |
| *** sriram has joined #openstack-marconi | 12:53 | |
| *** openstackgerrit has quit IRC | 12:54 | |
| *** openstackgerrit has joined #openstack-marconi | 12:54 | |
| *** oz_akan_ has quit IRC | 12:55 | |
| *** oz_akan_ has joined #openstack-marconi | 12:56 | |
| *** alcabrera has joined #openstack-marconi | 12:59 | |
| alcabrera | Good morning! :D | 13:00 |
| *** cpallares has joined #openstack-marconi | 13:02 | |
| *** mpanetta has joined #openstack-marconi | 13:03 | |
| flaper87 | alcabrera: morning :) | 13:06 |
| alcabrera | flaper87: heeeeyyy! | 13:06 |
| alcabrera | flaper87: how are you? | 13:06 |
| flaper87 | alcabrera: I'm doing fine, how are you doing? | 13:06 |
| alcabrera | awesome. I accidentally got some extra sleep last night and I feel pretty energized, as a result! | 13:07 |
| *** openstackgerrit has quit IRC | 13:08 | |
| flaper87 | alcabrera: lol @ accidentally | 13:08 |
| flaper87 | :D | 13:08 |
| *** openstackgerrit has joined #openstack-marconi | 13:08 | |
| flaper87 | sounds like: "I was walking around my place and then I fell asleep without noticing" | 13:09 |
| alcabrera | lol | 13:09 |
| alcabrera | not quite ;) | 13:09 |
| alcabrera | I woke up at 6am, then rolled over lazily, and fell asleep again 'til 8am | 13:10 |
| flaper87 | alcabrera: ah ok, that sounds safer than my example :D | 13:10 |
| flaper87 | alcabrera: hey, I wanted to ask you yday whether you've thought about possible tasks for the next OPW intership cycle | 13:11 |
| alcabrera | I hadn't. I've had that tab open for the past week. @_@ | 13:11 |
| *** mpanetta_ has joined #openstack-marconi | 13:15 | |
| *** mpanetta has quit IRC | 13:15 | |
| cpallares | alcabrera, flaper87: o/ | 13:21 |
| alcabrera | cpallares: good morning! :) | 13:22 |
| alcabrera | how are you, cpallares? | 13:22 |
| cpallares | alcabrera: I'm sleepy :P | 13:23 |
| cpallares | alcabrera: how are you doing? | 13:23 |
| alcabrera | energized. As I was telling flaper87 a little bit ago, I accidentally got two more hours of sleep than I intended. Rolled over at 6am and fell asleep 'til 8am. :P | 13:24 |
| *** jcru has joined #openstack-marconi | 13:26 | |
| alcabrera | flaper87: ping | 13:29 |
| *** balajiiyer has joined #openstack-marconi | 13:29 | |
| flaper87 | alcabrera: pong | 13:29 |
| alcabrera | saikrishna_ is interested in working on (https://bugs.launchpad.net/marconi/+bug/1239834) and was wondering if we could reassign it | 13:30 |
| alcabrera | since it's been sitting around for some time, I figured a reassignment would be okay. What do you think, flaper87? :) | 13:31 |
| flaper87 | alcabrera: that sounds good to me! | 13:32 |
| alcabrera | cool, cool. I'll do that reassign magic then. :) | 13:33 |
| alcabrera | thanks, flaper87! | 13:33 |
| *** amitgandhi has joined #openstack-marconi | 13:37 | |
| *** amitgandhi has quit IRC | 13:38 | |
| *** amitgandhi has joined #openstack-marconi | 13:39 | |
| *** mpanetta has joined #openstack-marconi | 13:41 | |
| *** mpanetta_ has quit IRC | 13:41 | |
| *** amarsharma has joined #openstack-marconi | 13:43 | |
| *** nosnos has quit IRC | 13:43 | |
| amarsharma | flaper87: Hey I am getting curl: (52) Empty reply from server after setting up marconi and sending curl -i -X PUT http://127.0.0.1:8888/v1/queues/samplequeue -H "Content-type: application/json" -d '{"metadata": "Sample Queue"}' | 13:44 |
| *** oz_akan_ has quit IRC | 13:45 | |
| alcabrera | amarsharma: creating a queue w/ PUT no longer takes metadata | 13:46 |
| alcabrera | that was changed a few months ago. :) | 13:46 |
| *** oz_akan_ has joined #openstack-marconi | 13:47 | |
| amarsharma | alcabrera: Then we should change this Guide on GitHub I followed the instruction there. | 13:47 |
| amarsharma | https://github.com/openstack/marconi | 13:47 |
| amarsharma | How can I test if my server is up and running ? | 13:48 |
| alcabrera | oh yes, that is out of date! | 13:48 |
| alcabrera | amarsharma: thanks for catching that. :) | 13:49 |
| alcabrera | so to test if the server is up | 13:49 |
| alcabrera | two | 13:49 |
| alcabrera | err | 13:49 |
| alcabrera | two things | 13:49 |
| alcabrera | one is to issue a GET against the home url (host:port/v1) | 13:49 |
| alcabrera | the other is to issue the PUT as above to create a queue, without the metadata | 13:49 |
| alcabrera | (/v1/queues/queuename) | 13:49 |
| alcabrera | (PUT /v1/queues/queuename) | 13:49 |
| amarsharma | alcabrera: Your welcome :) and now I am getting HTTP/1.1 403 Forwarding Loop Detected | 13:54 |
| amarsharma | Server: awarrenhttp/5.0.0.2.6 | 13:54 |
| amarsharma | I guess I should learn more about marconi internals | 13:54 |
| alcabrera | oh wow - I've never seen HTTP 403 | 13:54 |
| alcabrera | err | 13:54 |
| alcabrera | The Forwarding Loop issue | 13:55 |
| alcabrera | that's new | 13:55 |
| *** mpanetta_ has joined #openstack-marconi | 13:56 | |
| *** mpanetta has quit IRC | 13:56 | |
| amarsharma | wait body says: | 13:56 |
| amarsharma | <html> <head> <title> Internal Error </title> </head> <body> <hr> <h1> ERROR </h1> <h2> Forwarding loop detected. | 13:57 |
| amarsharma | <BR> <BR> Reason: Source and Destination are same </h2> </body> | 13:57 |
| alcabrera | now I'm tempted to follow the guide from a fresh marconi install to see if it explodes in this fashion | 14:00 |
| *** mwagner_lap has joined #openstack-marconi | 14:01 | |
| *** openstack has joined #openstack-marconi | 14:04 | |
| *** fungi has joined #openstack-marconi | 14:10 | |
| *** ChanServ sets mode: +o fungi | 14:10 | |
| *** fungi changes topic to "OpenStack Queuing and Notification Service || Smile :D || Meetings every Tuesday @ 15:00 UTC || Wiki: ttps://wiki.openstack.org/wiki/Marconi || Paste: http://paste.openstack.org/ || Send messages and make some noise :D" | 14:10 | |
| *** ChanServ sets mode: -o fungi | 14:10 | |
| *** fungi has left #openstack-marconi | 14:10 | |
| *** alcabrera is now known as alcabrera|afk | 14:11 | |
| *** malini has joined #openstack-marconi | 14:15 | |
| *** alcabrera|afk is now known as alcabrera | 14:16 | |
| *** Kuwagata has joined #openstack-marconi | 14:20 | |
| malini | o/ | 14:20 |
| cpallares | malini: \o | 14:21 |
| *** chandan_kumar has quit IRC | 14:22 | |
| malini | hello cpallares!! | 14:23 |
| cpallares | hello malini how are you? | 14:24 |
| *** chandan_kumar has joined #openstack-marconi | 14:25 | |
| malini | cpallares: good.ready for the devstack bug :) | 14:27 |
| *** mpanetta_ is now known as mpanetta | 14:27 | |
| *** Guest8106 has quit IRC | 14:27 | |
| *** jamieh has joined #openstack-marconi | 14:28 | |
| *** jamieh is now known as Guest24116 | 14:28 | |
| *** Anastas__ has joined #openstack-marconi | 14:29 | |
| *** Guest24116 is now known as jamiehannaford | 14:30 | |
| flaper87 | malini: soooo, any other good news ? | 14:30 |
| malini | flaper87: no..I am going to add an experimental job in devstack | 14:31 |
| malini | tht'll help us move a lil faster | 14:31 |
| malini | flaper87, alcabrera, flwang: I dont know if you have other priorities..But the next two days can we swarm on the stderr bug? | 14:31 |
| malini | sdague will definitely want to know abt tht during our graduation review on Tuesday | 14:32 |
| * alcabrera thinks about priority things | 14:32 | |
| malini | I will get the experimental job submitted today | 14:32 |
| alcabrera | malini: I know where marconi-server is bratty and writes to stdout (or stderr?), but I don't know why devstack chokes on it | 14:33 |
| alcabrera | time allowing, I want to take 1 full day to study devstack | 14:34 |
| malini | alcabrera: we are interested in why marcobi opens the stderr fd | 14:34 |
| alcabrera | it should open it by default | 14:34 |
| malini | why devstack does it a whole different topic | 14:34 |
| alcabrera | all processes do | 14:34 |
| malini | it is not supposed to - 'other projects dont do it' | 14:34 |
| alcabrera | I mean | 14:35 |
| alcabrera | every process on every operating system opens stderr. :( | 14:35 |
| malini | redirecting the stderr to stdout will keep marconinrunning | 14:35 |
| malini | marconi running* | 14:35 |
| alcabrera | I want to know why it writes to it, and why devstack explodes as a result | 14:35 |
| alcabrera | yes | 14:35 |
| alcabrera | that | 14:35 |
| alcabrera | :D | 14:35 |
| malini | alcabrera: dont worry abt the devstack explosion for now ;) | 14:36 |
| alcabrera | kk | 14:36 |
| malini | i.e. until we know why marconi writes to it | 14:36 |
| mpanetta | Who is saying that things don't open stderr/stdout?? | 14:36 |
| alcabrera | marconi-server writes to stderr because wsgiref does so by default | 14:36 |
| malini | mpanetta: devstack team | 14:36 |
| mpanetta | Uh, do they unix? :P | 14:36 |
| malini | flaper87, flwang: can you clarify how other openstack projects do this? | 14:37 |
| mpanetta | The bloody kernel opens those file descriptors for you on exec, unless you purposfully close them, they will be open... | 14:37 |
| mpanetta | It is just how things work... :( | 14:38 |
| flwang | malini: i need a little bit time to pick up the background | 14:38 |
| malini | we need to figure out how to get marconi running on devstack w/o the redirection | 14:38 |
| malini | We should focus on how to do tht in the next couple of days | 14:38 |
| mpanetta | malini: what about the suggstion I had last week? | 14:38 |
| alcabrera | I'm cloning the nova repo to investigate whether it uses wsgiref | 14:38 |
| malini | we can argue abt if its the right approach or not next week ;) | 14:38 |
| mpanetta | Or maybe it was 2 weeks ago now... | 14:38 |
| malini | mpanetta: which suggestion? | 14:39 |
| mpanetta | To do the daemonize thing | 14:39 |
| malini | I have done a lot of stuff so far ;) | 14:39 |
| flwang | malini: may I know how to reproduce it? | 14:39 |
| malini | flwang: sure..you need to tun devstack with USE_SCREEN = false | 14:40 |
| *** chandankumar_ has joined #openstack-marconi | 14:40 | |
| *** chandankumar_ has quit IRC | 14:40 | |
| malini | flwang: we current have a work around for the issue here https://github.com/openstack-dev/devstack/blob/master/lib/marconi#L157 | 14:40 |
| alcabrera | nova uses wsgiref in bare_metal_deploy, hmm... | 14:40 |
| flwang | malini: so now Marconi has been associated with devstack, andI just need to install openstack with devstack on USE_SCREEN = false | 14:41 |
| flwang | malini: to recreate this issue, is it? | 14:41 |
| malini | flwang: we should be able to get rid of the workaround "2>&1" without causing marconi to die | 14:41 |
| malini | flaper87: Yes | 14:41 |
| malini | flwang: Yes | 14:41 |
| malini | flaper87: sorry..tht was not for you | 14:41 |
| flaper87 | malini: :D | 14:42 |
| flwang | flaper87 is busy now i think | 14:42 |
| malini | now I know how to get his attention ;) | 14:42 |
| * flaper87 is fighting for what he thiks is right | 14:43 | |
| alcabrera | go, flaper87, go! | 14:44 |
| * alcabrera cheers flaper87 on | 14:44 | |
| flaper87 | <o/ <o> \o> | 14:44 |
| alcabrera | hmmm | 14:45 |
| alcabrera | none of [trove, heat, swift] use wsgiref | 14:45 |
| malini | alcabrera: intersting trove uses the same workaround | 14:45 |
| mpanetta | I saw that | 14:45 |
| mpanetta | malini: Didn't they say it wasn't technically needed anymore by trove tho? heh | 14:46 |
| malini | mpanetta: no. | 14:46 |
| malini | they said they 'might not' need it now | 14:46 |
| alcabrera | heat uses eventlet as the default wsgi server | 14:46 |
| mpanetta | Well how come they get to do it when we can't? | 14:46 |
| malini | mpanetta: I spent a good portion of my brain wondering abt tht..But tht argument wont help us . | 14:47 |
| malini | If we find out the root cause, we'll have a better argument | 14:47 |
| mpanetta | This whole thing is confusing to me. It almost feels to me like we are being punished for using falcon, and this is how they are punishing us. Redirecting file descriptors is standard practice in the unix world. :( | 14:48 |
| mpanetta | So we determined that wsgiref is using stderr right? alcabrera, malini? | 14:49 |
| malini | alcabrera: ? | 14:49 |
| malini | will adding a pdb help us figure out when stderr FD is getting opened? | 14:49 |
| flaper87 | IIRC, none of the openstack projects use wsgiref | 14:49 |
| flaper87 | am I wrong? | 14:49 |
| alcabrera | flaper87: that's what I'm seeing, except for maybe ceilometer and a small portion of nova | 14:50 |
| alcabrera | mpanetta, malini: we've verified that wsgiref writes to stderr | 14:50 |
| alcabrera | gonna reverify now | 14:50 |
| alcabrera | **I'm going to... | 14:50 |
| *** AnastasiosAndron has joined #openstack-marconi | 14:51 | |
| *** amarsharma has quit IRC | 14:51 | |
| alcabrera | most of the other projects seem to be using openstack/common/wsgi | 14:51 |
| alcabrera | which looks *really* awkward | 14:52 |
| malini | alcabrera: is it an easy change to try marconi with tht? | 14:52 |
| cpallares | haha alcabrera | 14:52 |
| flaper87 | that was the former wsgi lib in openstack, hence the migration to pecan | 14:52 |
| *** Anastas__ has quit IRC | 14:52 | |
| flaper87 | alcabrera: ^ | 14:52 |
| flaper87 | that's already deprecated in the incubator | 14:52 |
| alcabrera | flaper87: good to know | 14:53 |
| flaper87 | I'd expect *all* projects except from ceilo to be using that (or at least have used that) | 14:53 |
| alcabrera | malini: it wouldn't be an easy change | 14:53 |
| malini | alcabrera: ok..& since it is deprecated anyways.. | 14:53 |
| *** jmckind has joined #openstack-marconi | 14:54 | |
| mpanetta | Wait, so why can't we try and do http://legacy.python.org/dev/peps/pep-3143/ again? | 14:54 |
| alcabrera | re-verified: wsgiref logging writes to stderr | 14:55 |
| mpanetta | If we did the things in that pep we would not be writing to any stdthings nymore | 14:55 |
| mpanetta | And we don't even have to do them all really. | 14:57 |
| mpanetta | Here is the list of things, and we only have to do 1,4,6 and 7. And maybe not even 6... http://legacy.python.org/dev/peps/pep-3143/#correct-daemon-behaviour | 14:59 |
| * alcabrera reads | 15:00 | |
| *** AnastasiosAndron has quit IRC | 15:00 | |
| alcabrera | close all open file descriptors (0, 1, 2), run in the background, disassociate from control terminal | 15:01 |
| mpanetta | Yeah | 15:01 |
| alcabrera | gonna run a quick test | 15:01 |
| alcabrera | :D | 15:01 |
| alcabrera | oh | 15:02 |
| alcabrera | well that was fun | 15:02 |
| alcabrera | if you want to kill the python REPL | 15:02 |
| alcabrera | >>> import os | 15:02 |
| alcabrera | >>> os.close(0) | 15:02 |
| alcabrera | yup | 15:02 |
| mpanetta | Some programs reopen 0,1,2 and associate them with /dev/zero,/dev/null to do the dissassociation bit | 15:02 |
| mpanetta | Well, yeah you just closed your only source of input :P | 15:02 |
| mpanetta | It does not work too well with interactive programs. ;) | 15:03 |
| alcabrera | haha | 15:03 |
| *** saju_m has quit IRC | 15:03 | |
| *** saju_m has joined #openstack-marconi | 15:04 | |
| malini | alcabrera: other OS projects do not use wsgiref, rt? | 15:07 |
| alcabrera | malini: except for ceilometer and a part of swift, based on what I've seen in the past hour. | 15:08 |
| alcabrera | I git cloned a few of them. :) | 15:08 |
| alcabrera | *swift -> nova | 15:08 |
| alcabrera | I checked: marconi, ceilometer, heat, trove, swift, nova | 15:09 |
| malini | alcabrera: can you check if either of them have anything special to NOT use stderr? | 15:09 |
| mpanetta | alcabrera, malini would you like me to write a quick script that will wrap marconi-server and daemonize it, as a POC? | 15:09 |
| malini | mpanetta: sure..I can try tht in my devstack server | 15:09 |
| malini | it will be awesome, in fact :) | 15:09 |
| mpanetta | If it works we can move the important bits in to marconi-server | 15:10 |
| flaper87 | alcabrera: what is that list? | 15:10 |
| flaper87 | projects using wsgiref ? | 15:10 |
| malini | mpanetta: Yes | 15:10 |
| alcabrera | flaper87: the list of projects I cloned to check for wsgiref. I found that only marconi, ceilometer, and a small portion of nova use wsgiref. | 15:10 |
| alcabrera | nova:bare_metal_deploy:api | 15:11 |
| flaper87 | glance doesn't use wsgiref either | 15:11 |
| flaper87 | nor does cinder | 15:11 |
| alcabrera | I wonder why... | 15:11 |
| alcabrera | it seems like all of these should be launchable in a wsgi server chosen by the user | 15:11 |
| alcabrera | and that there's no harm in having a command like wsgiref as part of the "play/dev" command for each project | 15:12 |
| malini | alcabrera:Can we swap out wsgiref with something else to make sure tht is really the problem? | 15:14 |
| alcabrera | hmmm | 15:14 |
| malini | Tht'll confirm we are chasing the right thing | 15:15 |
| alcabrera | hmmm | 15:15 |
| alcabrera | I feel like I've swapped it out already | 15:16 |
| alcabrera | I've deployed marconi with both gunicorn and marconi-server (wsgiref-style) | 15:16 |
| alcabrera | output is only written to stderr with wsgiref | 15:16 |
| malini | cool - tht confirms something | 15:18 |
| malini | can you give me ur gunicorn command , alcabrera? | 15:18 |
| malini | I'll swapi it out in devstack script | 15:18 |
| alcabrera | gunicorn -b BIND:PORT marconi.queues.transport.wsgi.app:app | 15:18 |
| alcabrera | where BIND is usually localhost for me | 15:18 |
| malini | ok..trying now | 15:19 |
| alcabrera | PORT is usually 8001 | 15:19 |
| malini | alcabrera: it gets killed with gunicorn as well :( | 15:26 |
| *** chandan_kumar has quit IRC | 15:26 | |
| alcabrera | :/ | 15:28 |
| *** chandan_kumar has joined #openstack-marconi | 15:28 | |
| *** chandan_kumar has quit IRC | 15:28 | |
| mpanetta | try daemonizing gunicorn | 15:29 |
| mpanetta | I think the switch is -D | 15:29 |
| mpanetta | malini: ^^ | 15:29 |
| malini | mpanetta: trying now | 15:30 |
| alcabrera | the switch is -D | 15:30 |
| alcabrera | comnfirmed. :) | 15:30 |
| malini | I am running it with strace at the moment | 15:30 |
| alcabrera | gunicorn -D -b BIND:PORT marconi.queues.transport.wsgi.app:app | 15:30 |
| alcabrera | cool | 15:30 |
| alcabrera | keep me updated | 15:30 |
| mpanetta | Oh, strace will kill it probably | 15:30 |
| malini | it did ;? | 15:30 |
| malini | with -D it works :) | 15:32 |
| malini | so daemonizing might be our answer | 15:32 |
| alcabrera | sweet | 15:32 |
| alcabrera | gunicorn it and call it done. :D | 15:33 |
| mpanetta | Of course it is :P | 15:33 |
| malini | ok..how do/can we daemonize marconi? | 15:33 |
| mpanetta | Will they allow us to pull in gunicorn? | 15:33 |
| malini | I dont think so | 15:33 |
| alcabrera | dang... | 15:33 |
| alcabrera | so | 15:33 |
| alcabrera | daemonizing marconi-server | 15:33 |
| alcabrera | there's no command line option for that | 15:33 |
| alcabrera | because wsgiref doesn't understand daemonizing | 15:33 |
| alcabrera | so we'd have to roll our own | 15:34 |
| malini | hopefully mpanetta's wrapper will help | 15:34 |
| malini | let me know when its ready , mpanetta | 15:34 |
| mpanetta | ok | 15:34 |
| malini | I'll give it a try | 15:34 |
| mpanetta | can you give me the full path to marconi-server please? | 15:34 |
| alcabrera | marconi/cmd/server.py | 15:35 |
| alcabrera | mpanetta: ^ | 15:35 |
| mpanetta | Oh sorry I mean the installed executable | 15:36 |
| mpanetta | I am going to call it with os.exec | 15:36 |
| mpanetta | If this works I will put the code in server.py | 15:36 |
| malini | mpanetta: $ which marconi-server | 15:36 |
| malini | /usr/local/bin/marconi-server | 15:36 |
| mpanetta | And that is on the devstack system correct? | 15:36 |
| malini | yes | 15:36 |
| mpanetta | cool | 15:37 |
| *** saju_m has quit IRC | 15:40 | |
| malini | mpanetta: shud I replace marconi/cmd/server.py with https://gist.github.com/anonymous/e32db6a5bc86bb2918a9 ? | 15:52 |
| mpanetta | Hmm not replace | 15:53 |
| mpanetta | It should go in to run() right before server.run I think | 15:54 |
| malini | mpanetta: ok..let me try | 15:54 |
| flaper87 | quick question: What's the workaround we have now ? | 15:54 |
| flaper87 | Was it applied to devstack ? | 15:55 |
| malini | flaper87: yes | 15:55 |
| flaper87 | damn | 15:55 |
| flaper87 | I was about to ask if we could live with that | 15:55 |
| flaper87 | anyway | 15:55 |
| malini | The 2&1 in https://github.com/openstack-dev/devstack/blob/master/lib/marconi#L157 | 15:55 |
| malini | that is temporary :( | 15:55 |
| flaper87 | can we live with that ? | 15:55 |
| flaper87 | :D | 15:55 |
| malini | I can ..but not a few others ;) | 15:55 |
| *** reed has joined #openstack-marconi | 16:00 | |
| malini | mpanetta: I updated server.py | 16:02 |
| malini | But now I can no longer start with marconi-server | 16:02 |
| *** balajiiyer has quit IRC | 16:06 | |
| malini | flaper87, alcabrera, flwang: mpanetta's fix solves the issue :) | 16:11 |
| flaper87 | malini: yeah, lets call it fix... | 16:12 |
| malini | https://gist.github.com/anonymous/e32db6a5bc86bb2918a9 | 16:12 |
| flaper87 | :D | 16:12 |
| malini | is it acceptable to introduce this in marconi? | 16:12 |
| *** AAzza1 has joined #openstack-marconi | 16:12 | |
| flaper87 | why not? | 16:12 |
| malini | wooot woot | 16:12 |
| flaper87 | the whole point behind wsgiref is to have a toy server to play with | 16:13 |
| malini | mpanetta: can you submit a patch with your changes? | 16:13 |
| *** balajiiyer has joined #openstack-marconi | 16:13 | |
| flaper87 | not to use it in production | 16:13 |
| malini | yes!! | 16:13 |
| malini | & the point of devstack is to aid development <sigh> | 16:13 |
| mpanetta | wee | 16:13 |
| mpanetta | Um | 16:13 |
| mpanetta | I think I can ;) | 16:13 |
| malini | cool ! | 16:13 |
| malini | Our blocker now is the journaling patch.. | 16:13 |
| malini | I need some eyes on tht | 16:14 |
| malini | https://review.openstack.org/#/c/74088/ | 16:14 |
| malini | I am pinging some core folks for tht | 16:15 |
| malini | I hope this will end all our problems :) | 16:16 |
| AAzza1 | flaper87: Hello again! I'm shy girl who wants to try for OPW this year, Can you propose good easy bug for me to start with? :) | 16:16 |
| cpallares | Welcome AAzza1 :) | 16:17 |
| flaper87 | AAzza1: hey hey hey! | 16:17 |
| flaper87 | Don't be shy, this is a fun channel, full of fun people | 16:18 |
| flaper87 | AAzza1: people and robots | 16:18 |
| alcabrera | AAzza1: welcome! | 16:18 |
| flaper87 | and some other kind of unknown beings | 16:18 |
| flaper87 | AAzza1: let me help you with that bug hunting thing | 16:19 |
| * cpallares wonders if flaper87 is an unknown being or a robot | 16:20 | |
| flaper87 | cpallares: and evolution of the mutation of both | 16:20 |
| AAzza1 | okey, separate hi to all the uknown beings:) Yeah ,I just need something to start knowing the system | 16:20 |
| flaper87 | s/and/an/ | 16:20 |
| AAzza1 | May I just want to ask the irrelevant question, that bothered me for years, how do you test you messaging service? I find people who should know the answer | 16:22 |
| AAzza1 | just cann't imagine how to do this with all this transport etc | 16:23 |
| flaper87 | AAzza1: It depends on the test. For example, if it's an unit test, you can mock the transports and test the "happy path" | 16:24 |
| flaper87 | in the case of functional tests, you need to have a running service that the test can talk to | 16:24 |
| flaper87 | In marconi's functional tests, it starts a marconi instance in the background and tests everyting against that instance | 16:25 |
| *** rossk has joined #openstack-marconi | 16:26 | |
| AAzza1 | Hmm... I see, all bunch of tests should run for a while i think :) | 16:26 |
| flaper87 | AAzza1: yeah | 16:26 |
| alcabrera | the unit-ish suite manages to execute in about 200 seconds, last I tried the full run. :) | 16:26 |
| cpallares | flaper87: someone this morning mentioned to alcabrera that the curl request in the readme was outdated, that would be a simple bug to fix. | 16:27 |
| flaper87 | AAzza1: so, I heard the examples in the README are not up-to-date | 16:27 |
| cpallares | lol | 16:27 |
| flaper87 | AAzza1: that's something you could contribute to, if you want | 16:27 |
| openstackgerrit | Mike Panetta proposed a change to openstack/marconi: Allow marconi-server to properly daemonize https://review.openstack.org/79986 | 16:27 |
| flaper87 | cpallares: I told you, evolution of the mutation of (robot+unknown being) | 16:28 |
| mpanetta | Oh yeah, I don't have to paste the link heh | 16:28 |
| mpanetta | malini: ^^ | 16:28 |
| cpallares | flaper87: does that give you psychic powers now? | 16:28 |
| flaper87 | mpanetta: there are some trailing spaces in your patch | 16:28 |
| mpanetta | Ah crap | 16:28 |
| alcabrera | mpanetta: flaper87 beat me to it | 16:29 |
| flaper87 | cpallares: oh you've no idea :D | 16:29 |
| mpanetta | It is bad anyway, I forgot the import. :P Let me fix it. | 16:29 |
| alcabrera | also | 16:29 |
| mpanetta | Where are the spaces? | 16:29 |
| AAzza1 | Oh, thanks, I'll look :) | 16:30 |
| alcabrera | mpanetta: gerrit shows them above. :) | 16:30 |
| alcabrera | also, reviewed: python3 nit | 16:31 |
| mpanetta | Yeh I should have got rid of that, sorry :( | 16:32 |
| mpanetta | Should I just completely remove that line? | 16:32 |
| mpanetta | Nevermind, I got it. | 16:33 |
| alcabrera | kk | 16:33 |
| alcabrera | run 'tox -e pep8' before sending in the patch. It'll catch all the silly whitespace errors. :) | 16:33 |
| *** saikrishna_ has joined #openstack-marconi | 16:35 | |
| *** reed has quit IRC | 16:44 | |
| openstackgerrit | Mike Panetta proposed a change to openstack/marconi: Allow marconi-server to properly daemonize https://review.openstack.org/79986 | 16:46 |
| *** jamiehannaford has quit IRC | 16:47 | |
| alcabrera | mpanetta: +2 | 16:48 |
| mpanetta | Yay! | 16:48 |
| mpanetta | I really hope this gets us past this hurdle. | 16:49 |
| flaper87 | mpanetta: just a really small request | 16:50 |
| flaper87 | sorry for not raising it before | 16:50 |
| flaper87 | would you mind adding a comment saying that this is all wsgiref faults ? | 16:51 |
| flaper87 | I mean, we're crazy but not stupid | 16:51 |
| flaper87 | I don't want people to think the later | 16:51 |
| flaper87 | :D | 16:51 |
| mpanetta | haha | 16:51 |
| mpanetta | Where would you like me to make the comment? | 16:51 |
| mpanetta | Just ammend mt commit log? | 16:51 |
| flaper87 | righ above this: # Open /dev/zero and /dev/null for redirection. | 16:51 |
| mpanetta | Ah ok | 16:52 |
| mpanetta | yep sec. | 16:52 |
| flaper87 | mpanetta: just explain why we need that hack | 16:52 |
| flaper87 | and how much we hate wsgiref now | 16:52 |
| mpanetta | haha ok | 16:52 |
| flaper87 | and that malini will pay whoever fixes wsgiref | 16:52 |
| mpanetta | A million dollars right? :P | 16:53 |
| mpanetta | flaper87: How about: | 16:54 |
| mpanetta | https://gist.github.com/anonymous/89ed46f9274664ec2df0 | 16:54 |
| mpanetta | flaper87: Does that look good, or is it too long? | 16:55 |
| flaper87 | mpanetta: sounds good. Maybe add "This is specifically needed to allow marconi run under devstack but it may be also useful for other scenarios" | 16:55 |
| alcabrera | works for me, mpanetta | 16:55 |
| flaper87 | mpanetta: documentation is never long enough | 16:55 |
| flaper87 | hauhauhauhua | 16:55 |
| alcabrera | map :: (a -> b) -> [a] -> [b] -- most succinct docs | 16:56 |
| alcabrera | :P | 16:56 |
| mpanetta | I still fail at reading haskell :P | 16:56 |
| alcabrera | hehe | 16:58 |
| openstackgerrit | Mike Panetta proposed a change to openstack/marconi: Allow marconi-server to properly daemonize https://review.openstack.org/79986 | 16:59 |
| alcabrera | I need to host that haskell workshop at rax:atl | 16:59 |
| alcabrera | after that, I'd aim for everyone who attended to be able to read most type signatures | 16:59 |
| openstackgerrit | Mike Panetta proposed a change to openstack/marconi: Allow marconi-server to properly daemonize https://review.openstack.org/79986 | 17:02 |
| mpanetta | Sorry had one space issue. | 17:02 |
| *** alcabrera is now known as alcabrera|afk | 17:02 | |
| *** sballe has joined #openstack-marconi | 17:03 | |
| *** balajiiyer has quit IRC | 17:03 | |
| *** balajiiyer has joined #openstack-marconi | 17:03 | |
| flaper87 | mpanetta: LGTM, thanks | 17:04 |
| *** balajiiyer1 has joined #openstack-marconi | 17:04 | |
| *** balajiiyer has quit IRC | 17:08 | |
| *** sballe has quit IRC | 17:10 | |
| *** reed has joined #openstack-marconi | 17:10 | |
| *** saju_m has joined #openstack-marconi | 17:16 | |
| *** cpallares has quit IRC | 17:18 | |
| *** jamieh has joined #openstack-marconi | 17:21 | |
| *** jamieh is now known as Guest35613 | 17:21 | |
| *** Guest35613 has quit IRC | 17:23 | |
| *** openstackstatus has quit IRC | 17:38 | |
| *** amarsharma has joined #openstack-marconi | 17:38 | |
| *** openstackstatus has joined #openstack-marconi | 17:38 | |
| *** reed has quit IRC | 17:57 | |
| *** reed has joined #openstack-marconi | 17:57 | |
| *** amarsharma has quit IRC | 17:58 | |
| *** amarsharma has joined #openstack-marconi | 17:58 | |
| *** amarsharma has quit IRC | 18:01 | |
| *** amarsharma has joined #openstack-marconi | 18:01 | |
| *** amarsharma has quit IRC | 18:03 | |
| *** amarsharma has joined #openstack-marconi | 18:03 | |
| *** amarsharma has quit IRC | 18:08 | |
| *** cpallares has joined #openstack-marconi | 18:08 | |
| amitgandhi | flaper87: you will have to visit this place when you come to atlanta | 18:11 |
| amitgandhi | https://www.google.com/maps/@34.089669,-84.25018,3a,15y,304.93h,95.58t/data=!3m4!1e1!3m2!1sDp7sguRtzaMdeROxOulbeg!2e0 | 18:11 |
| mpanetta | flaper87: No problem :) | 18:12 |
| *** alcabrera|afk has quit IRC | 18:14 | |
| *** alcabrera has joined #openstack-marconi | 18:14 | |
| openstackgerrit | Oz Akan proposed a change to openstack/marconi: Marconi Operations Document https://review.openstack.org/78294 | 18:24 |
| *** saju_m has quit IRC | 18:30 | |
| alcabrera | mpanetta: I thought about the review a little more. Can you check out sys.exit instead of os._exit? | 18:33 |
| alcabrera | https://review.openstack.org/#/c/79986/4/marconi/cmd/server.py | 18:33 |
| malini | my experimental job for devstack is now merged - now we can experiment on devstack without having to get it merged | 18:44 |
| malini | flaper87: can you take a look at https://review.openstack.org/#/c/79986/ ? | 18:47 |
| alcabrera | flwang: ^ | 18:50 |
| alcabrera | :D | 18:50 |
| alcabrera | it should be the minimum patch needed to have marconi-server be on good terms with devstack | 18:50 |
| malini | & we need to know soon, if tht will fix it | 18:59 |
| malini | It did locally on my devstack | 18:59 |
| *** saikrishna_ has quit IRC | 19:03 | |
| *** malini is now known as malini_afk | 19:27 | |
| mpanetta | alcabrera: You want me to change that? | 19:36 |
| *** AAzza1 has quit IRC | 19:36 | |
| alcabrera | mpanetta: yes, please. Let's test with sys.exit. That'd be the correct thing to do, with the smallest fear of breakage across OSes and Python versions. | 19:36 |
| mpanetta | ere is the note I was going on in the python docs: Note The standard way to exit is sys.exit(n). _exit() should normally only be used in the child process after a fork(). | 19:36 |
| alcabrera | hmmmm | 19:37 |
| mpanetta | Since I was using it after the fork... | 19:37 |
| alcabrera | I see. | 19:37 |
| alcabrera | Could you link to the docs? | 19:37 |
| mpanetta | http://docs.python.org/2/library/os.html#process-management | 19:37 |
| flaper87 | mpanetta: there's got to be a better way to do it without calling a privatre function | 19:38 |
| flaper87 | :/ | 19:38 |
| alcabrera | Found it: http://docs.python.org/2/library/os.html#os._exit | 19:38 |
| flaper87 | please, tell me there is | 19:38 |
| mpanetta | I don't mind calling sys.exit | 19:38 |
| flaper87 | :D | 19:38 |
| alcabrera | haha | 19:38 |
| alcabrera | that's what the docs say, flaper87. :P | 19:38 |
| flaper87 | damn :( | 19:39 |
| mpanetta | Yeah it isn't private. Well if it is, it is well documented :P | 19:39 |
| alcabrera | mpanetta: all functions with '_' prefixing them are considered private, by python convention | 19:39 |
| mpanetta | I originally has os.exit(), but changed it based on that note, and that the daemon library uses that too. | 19:39 |
| mpanetta | alcabrera: Ah! | 19:39 |
| mpanetta | Thank you :) | 19:39 |
| alcabrera | np. :) | 19:39 |
| alcabrera | so | 19:39 |
| alcabrera | I'm favorable towards os._exit | 19:40 |
| alcabrera | after reading the docs | 19:40 |
| alcabrera | all the more so since there's a note stating that this is the way to go for forked children | 19:40 |
| mpanetta | I promise I didn't pull that usage out of my posterior. I am not knowledgable enough in python (yet?) to do that :P | 19:41 |
| alcabrera | the note persists into python 3-latest: http://docs.python.org/3/library/os.html#os._exit | 19:41 |
| alcabrera | so, it's a design decision that's here to stay, afaict | 19:41 |
| mpanetta | Ok | 19:41 |
| mpanetta | Want me to keep it then? | 19:41 |
| mpanetta | You guys know best | 19:42 |
| alcabrera | os._exit is my vote, mpanetta | 19:42 |
| mpanetta | ok | 19:42 |
| alcabrera | I left the doc comments in the review | 19:43 |
| alcabrera | pointing to both py2-latest and py3-latest docs | 19:43 |
| mpanetta | Ok | 19:43 |
| *** sriram has quit IRC | 19:44 | |
| alcabrera | flaper87: your blessing can save the world, though it can wait 'til tomorrow morning. ;) | 19:44 |
| flaper87 | alcabrera: mpanetta done :) | 19:46 |
| mpanetta | Yay! | 19:46 |
| mpanetta | Thank you so much alcabrera and flaper87 | 19:46 |
| flaper87 | mpanetta: thank you for debugging / fixing that | 19:47 |
| alcabrera | thanks all - malini_afk will celebrate tomorrow. :) | 19:47 |
| mpanetta | flaper87: I had fun :) | 19:48 |
| openstackgerrit | A change was merged to openstack/marconi: Allow marconi-server to properly daemonize https://review.openstack.org/79986 | 19:48 |
| flaper87 | that was fast | 19:50 |
| flaper87 | why doesn't that happen with my patches ? | 19:50 |
| flaper87 | mpanetta: >.> | 19:50 |
| alcabrera | lol | 19:56 |
| alcabrera | I'm out for the night, all. Take care! | 19:58 |
| *** alcabrera has quit IRC | 19:58 | |
| mpanetta | flaper87: I donno :P | 19:59 |
| *** cpallares has left #openstack-marconi | 20:13 | |
| *** malini_afk is now known as malini | 20:57 | |
| malini | flaper87: the journaling thing doesnt seem to help https://review.openstack.org/#/c/74088/ | 20:59 |
| malini | :( | 20:59 |
| *** AAzza has joined #openstack-marconi | 20:59 | |
| malini | flaper87: But atleast we have an experimental job in devstack now..So we can iterate faster | 21:02 |
| flaper87 | malini: mmh | 21:05 |
| flaper87 | let me take a look | 21:05 |
| AAzza | Hi, can someone tell me, how to run tests. at least unittests?) just cannot figure out (shy) | 21:06 |
| malini | meanwhile I'll add a ' if [[ "$MARCONI_BACKEND" = 'mongodb' ]]; then' to look similar to how it was before the patch & run the experimental job. | 21:07 |
| malini | Just to make sure mongo db is the issue | 21:07 |
| malini | AAzza: tox -e py27 | 21:07 |
| malini | AAzza: we really need some docs on how to run the tests | 21:08 |
| malini | maybe you could add them, once you figure out? | 21:08 |
| AAzza | malini: maybe i can add info to readme about this? | 21:09 |
| malini | AAzza: that would be awesome!! | 21:09 |
| AAzza | malini: and also, should i install something other from requirements-test? tox command is not found( | 21:09 |
| malini | yes..you need tox | 21:10 |
| malini | I believe cpallares ran into some issues recently | 21:10 |
| malini | & had to use an older version of tox | 21:10 |
| malini | try tox (1.6.1) | 21:11 |
| AAzza | malini: hmm... i'll try, but there is no tox in test-requirements. is it ok? | 21:12 |
| *** Kuwagata has quit IRC | 21:12 | |
| malini | good point..I dont know why, there's got to be a reason | 21:13 |
| AAzza | malini: yeah, it runs with tox==1.6.1. thanks) | 21:14 |
| flaper87 | malini: FWIW, something really bad happened to this job: http://logs.openstack.org/88/74088/4/experimental/check-tempest-dsvm-marconi/5400c48/console.html | 21:16 |
| flaper87 | try running it again | 21:17 |
| flaper87 | lol | 21:17 |
| flaper87 | just read your comment | 21:17 |
| flaper87 | nvm | 21:17 |
| flaper87 | malini: are you following up with -infra about that failure ? | 21:19 |
| flaper87 | that doesn't seem related to mongodb / marconi / whatsoever | 21:19 |
| *** mpanetta has quit IRC | 21:27 | |
| malini | flaper87: why do you think its unrelated? | 21:28 |
| malini | http://logs.openstack.org/88/74088/4/experimental/check-tempest-dsvm-marconi/5400c48/logs/error.txt.gz | 21:29 |
| malini | they recently changed devstack to quit in case of errors | 21:29 |
| malini | So I believe it just aborted coz of the marconi error | 21:29 |
| flaper87 | malini: ah mmh, I had not seen that log | 21:30 |
| flaper87 | :D | 21:30 |
| malini | np..Thts all I have been doing for a month now | 21:30 |
| malini | So I know where the error wud show up :D | 21:30 |
| *** oz_akan_ has quit IRC | 21:33 | |
| *** balajiiyer1 has quit IRC | 21:49 | |
| *** fifieldt has joined #openstack-marconi | 21:54 | |
| *** jmckind has quit IRC | 21:58 | |
| *** AAzza has quit IRC | 22:02 | |
| *** mwagner_lap has quit IRC | 22:04 | |
| *** amitgandhi has quit IRC | 22:23 | |
| *** jergerber has joined #openstack-marconi | 22:36 | |
| *** malini is now known as malini_afk | 22:39 | |
| *** jergerber has quit IRC | 22:41 | |
| *** jcru has quit IRC | 22:49 | |
| *** balajiiyer has joined #openstack-marconi | 23:32 | |
| *** jqiu25 has joined #openstack-marconi | 23:53 | |
| *** oz_akan_ has joined #openstack-marconi | 23:54 | |
| *** mpanetta has joined #openstack-marconi | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!