| *** aaronsheffield has quit IRC | 00:07 | |
| openstackgerrit | Stacey Fletcher proposed openstack/airship-pegleg master: Search all scopes for catalogs https://review.openstack.org/634821 | 00:27 |
|---|---|---|
| openstackgerrit | Arun Kant proposed openstack/airship-shipyard master: Adding opensuse support in image building of airflow and shipyard https://review.openstack.org/636229 | 00:37 |
| *** lemko has quit IRC | 00:39 | |
| *** sthussey has quit IRC | 01:12 | |
| *** nishant_ has quit IRC | 01:38 | |
| *** roman_g has quit IRC | 05:43 | |
| *** lemko has joined #airshipit | 06:47 | |
| *** roman_g has joined #airshipit | 09:00 | |
| openstackgerrit | Smruti Soumitra Khuntia proposed openstack/airship-drydock master: End user logging for audit traceabilty https://review.openstack.org/638115 | 09:54 |
| openstackgerrit | Smruti Soumitra Khuntia proposed openstack/airship-drydock master: End user logging for audit traceabilty https://review.openstack.org/638115 | 09:56 |
| openstackgerrit | Smruti Soumitra Khuntia proposed openstack/airship-armada master: End user logging for audit traceabilty https://review.openstack.org/638124 | 10:17 |
| openstackgerrit | Smruti Soumitra Khuntia proposed openstack/airship-shipyard master: User context tracing through logging https://review.openstack.org/633873 | 10:32 |
| *** ianychoi has quit IRC | 10:59 | |
| openstackgerrit | Smruti Soumitra Khuntia proposed openstack/airship-armada master: End user logging for audit traceabilty https://review.openstack.org/638124 | 12:38 |
| openstackgerrit | Roman Gorshunov proposed openstack/airship-divingbell master: Fix docs build on ReadTheDocs, enchance renderring https://review.openstack.org/638144 | 13:00 |
| openstackgerrit | Smruti Soumitra Khuntia proposed openstack/airship-shipyard master: User context tracing through logging https://review.openstack.org/633873 | 13:14 |
| *** ianychoi has joined #airshipit | 13:22 | |
| *** meriadec has joined #airshipit | 13:32 | |
| openstackgerrit | Roman Gorshunov proposed openstack/airship-divingbell master: Fix docs build on ReadTheDocs, enchance renderring https://review.openstack.org/638144 | 13:37 |
| *** aaronsheffield has joined #airshipit | 13:52 | |
| *** dustinspecker has joined #airshipit | 14:38 | |
| *** dimitris_ has quit IRC | 15:08 | |
| *** michael-beaver has joined #airshipit | 15:11 | |
| *** michaelbeaver has joined #airshipit | 15:22 | |
| *** michael-beaver has quit IRC | 15:25 | |
| openstackgerrit | Roman Gorshunov proposed openstack/airship-divingbell master: Fix docs build on ReadTheDocs, enchance renderring https://review.openstack.org/638144 | 15:41 |
| openstackgerrit | Roman Gorshunov proposed openstack/airship-divingbell master: Fix docs build on ReadTheDocs, enchance renderring https://review.openstack.org/638144 | 16:10 |
| dwalt | o/ everyone! Reminder that tomorrow is the weekly Airship design call (occurs Thursdays at this time, 1600 UTC). I'm sending the etherpad/meeting agenda if anyone has anything to add https://etherpad.openstack.org/p/Airship_OpenDesignDiscussions | 16:15 |
| openstackgerrit | Alexander Hughes proposed openstack/airship-pegleg master: Add CLI generation of salt https://review.openstack.org/637997 | 16:51 |
| hogepodge | mattmceuen: portdirect: do you have any links to your forum and PTG planning docs? | 17:51 |
| openstackgerrit | Arun Kant proposed openstack/airship-shipyard master: Adding opensuse support in image building of airflow and shipyard https://review.openstack.org/636229 | 17:58 |
| openstackgerrit | Michael Beaver proposed openstack/airship-armada master: Support in Armada for locking Tiller https://review.openstack.org/632483 | 18:16 |
| *** JosW has joined #airshipit | 19:04 | |
| *** rihbb has joined #airshipit | 19:52 | |
| rihbb | Hi, while deploying site through shipyard the execution script (after running successfully for an hour) exits with the message "Workflow Execution timed out" (https://paste.ubuntu.com/p/YZN6TwrVNk/) but there are no details as to why and what failed (all pods seem to be in Running State). | 19:53 |
| rihbb | Does anyone know what could have caused this issue? Thanks. | 19:53 |
| dustinspecker | rihbb: Can you point to which execution script you are running? Have you looked at output of `shipyard describe ACTION_ID` by any chance? | 19:56 |
| evgenyl | rihbb: Hi, there are many things that could cause the issue, from the log you sent, I see that there was `X7292WWET38D/armada_build` was running when it failed, this means that deployment got stuck on some of the stages, or it was not able to finish the deployment within specified time. You will need look into armada-api pod log to see what were the last steps it was executing. | 19:56 |
| dustinspecker | Sorry, that paste link isn't loading for me... | 19:57 |
| evgenyl | dustinspecker: does this one work http://paste.openstack.org/show/745510/ ? | 19:58 |
| dustinspecker | Yep! Thank you! Not sure why other one doesn't. | 19:59 |
| evgenyl | rihbb: by the way, it may be the case that everything was fine and timeout value was not large enough for you environment, so it may be the case that you would just need to restart site_update. | 20:07 |
| openstackgerrit | Michael Beaver proposed openstack/airship-armada master: Support in Armada for locking Tiller https://review.openstack.org/632483 | 20:15 |
| rihbb | evgenyl: I see. https://paste.ubuntu.com/p/HMCSN2FcmH/ shows how the logs of armada api pod look like after glance is deployed. Nothing gets deployed after glance. There is no error message in the armada api logs after deployment of glance. | 20:25 |
| rihbb | However I can't see nova, neutron, etc pods being deployed. Here is how the final deployment looks like: https://paste.ubuntu.com/p/sNKh24kmN5/ | 20:26 |
| rihbb | There are a couple of warnings though in the beginning of armada logs - https://paste.ubuntu.com/p/hmGGjJJGmc/. Do you think these warnings could cause the timeout? | 20:30 |
| evgenyl | rihbb: Hmm, at a first glance everything looks fine, but I would suggest to try to re-run site_update, it will ensure that the state of the cluster is what is defined in the manifests. | 20:31 |
| openstackgerrit | Lev Morgan proposed openstack/airship-pegleg master: CLI: Add command to generate genesis bundle https://review.openstack.org/613392 | 20:31 |
| evgenyl | rihbb: I don't think so. | 20:31 |
| evgenyl | rihbb: You can also check the jobs `kubectl get jobs --all-namespaces` | 20:32 |
| rihbb | evgenyl: Okay, I will try running update_site.sh script to see if that fixes the timeout. Thanks for the hints! | 20:38 |
| rihbb | kubectl get jobs --all-namespaces looks like this: https://paste.ubuntu.com/p/NDFm7H9VpC/ | 20:39 |
| mattmceuen | hogepoge: not yet, but will start on that soon | 20:39 |
| evgenyl | rihbb: `glance-bootstrap` shows DESIRED - 1 and SUCCESSFUL - 0, in a list of containers I see `glance-bootstrap-mxqwh` in a running state, it means that it has not finished bootstrapping glance, I would assume that the problem is indeed in timeout value being too small for your env. | 20:45 |
| rihbb | evgenyl: I see. I will run update_site.sh with increased timeout (Default seems 1.5 hour). Thanks a lot for the hints! | 20:49 |
| evgenyl | rihbb: Sure, sometimes it may get stuck in a weird state, if this happens see what jobs are running and look into pod logs, and as usual let me know if there are some problems. | 20:53 |
| evgenyl | We should probably write some Debug/FAQ guide for the cases when things do not go as planned :) | 20:54 |
| mattmceuen | agree :) | 20:54 |
| *** JosW has quit IRC | 20:56 | |
| rihbb | evgenyl: Sure & thanks! Yes I agree - Debug/FAQ guide should be there. I would also like to contribute to that if needed :) | 21:00 |
| mattmceuen | Do you guys think this would be a better fit for more formal code-reviewed documentation, or for something on our wiki? | 21:02 |
| openstackgerrit | Dmitrii Kabanov proposed openstack/airship-maas master: Add kernel boot options https://review.openstack.org/638267 | 21:05 |
| openstackgerrit | diwakar thyagaraj proposed openstack/airship-promenade master: UCP: Enable Audit Logging feature gate in K8s https://review.openstack.org/635568 | 21:08 |
| openstackgerrit | diwakar thyagaraj proposed openstack/airship-promenade master: UCP: Enable Audit Logging feature gate in K8s https://review.openstack.org/635568 | 21:10 |
| evgenyl | mattmceuen: I'm think we should get somewhere alongside site authoring guide, which is in treasuremap repo. | 21:12 |
| openstackgerrit | diwakar thyagaraj proposed openstack/airship-promenade master: UCP: Enable Audit Logging feature gate in K8s https://review.openstack.org/635568 | 21:16 |
| evgenyl | *I think | 21:17 |
| *** rihbb has quit IRC | 21:25 | |
| *** dustinspecker has quit IRC | 21:54 | |
| openstackgerrit | Anthony Bellino proposed openstack/airship-deckhand master: [chart] Enable liveness probe in DH https://review.openstack.org/638275 | 21:55 |
| openstackgerrit | Drew Walters proposed openstack/airship-treasuremap master: global: Add nfs-provisioner chart https://review.openstack.org/635217 | 22:05 |
| openstackgerrit | Drew Walters proposed openstack/airship-treasuremap master: airskiff: Pull rather than build Airship images https://review.openstack.org/635231 | 22:05 |
| openstackgerrit | Drew Walters proposed openstack/airship-treasuremap master: WIP: airskiff: Use global Airship charts https://review.openstack.org/635218 | 22:05 |
| openstackgerrit | Drew Walters proposed openstack/airship-treasuremap master: WIP: airskiff: Use global Airship charts https://review.openstack.org/635218 | 22:06 |
| openstackgerrit | Sean Eagan proposed openstack/airship-promenade master: [WIP]: Use v1 k8s api version objects https://review.openstack.org/638276 | 22:06 |
| dwalt | roman_g: it looks like your doc patch from the other day should go through after the gate jobs run. An un-pinned dependency in Deckhand updated to a bad version but has been fixed as of today https://review.openstack.org/635357 | 22:14 |
| openstackgerrit | Sean Eagan proposed openstack/airship-armada master: Revert "Revert "Use UBUNTU_BASE_IMAGE instead of BASE_IMAGE"" https://review.openstack.org/638282 | 22:34 |
| openstackgerrit | Merged openstack/airship-deckhand master: Embed UML generated diagrams into docs, fix docs build https://review.openstack.org/635357 | 22:36 |
| *** lemko has quit IRC | 22:41 | |
| openstackgerrit | Merged openstack/airship-treasuremap master: Auto chart/image uplift to latest https://review.openstack.org/637983 | 23:19 |
| *** michael-beaver has joined #airshipit | 23:24 | |
| *** michaelbeaver has quit IRC | 23:26 | |
| *** michael-beaver has quit IRC | 23:34 | |
| *** aaronsheffield has quit IRC | 23:41 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!