Monday, 2021-05-24

*** thansen has joined #airshipit01:02
*** parallax has left #airshipit09:59
airship-irc-bot<sirishagopigiri> Hi Team, Requesting review for treasuremap issue #27 https://review.opendev.org/c/airship/images/+/792740 -- adding provisioner chart to helm-collator image https://review.opendev.org/c/airship/treasuremap/+/788289 -- adding local-static-provisioner charts Thank you in advance!13:00
airship-irc-bot<sirishagopigiri> Hi Team, Requesting some reviews on the below PSs related to #280 and #281 https://review.opendev.org/c/airship/airshipctl/+/790020 https://review.opendev.org/c/airship/airshipctl/+/790023 https://review.opendev.org/c/airship/airshipctl/+/790026 https://review.opendev.org/c/airship/airshipctl/+/790033 https://review.opendev.org/c/airship/airshipctl/+/789250 https://review.opendev.org/c/airship/airshipctl/+/78683814:27
airship-irc-bothttps://review.opendev.org/c/airship/airshipctl/+/789775 -- 281 Thank you in advance!14:27
airship-irc-bot<sirajudeen.yasin> Team, Requesting some reviews for this PS https://review.opendev.org/c/airship/airshipctl/+/792060 => Update metadata.yaml to kubernetes style14:33
airship-irc-bot<ratnopam.chakrabarti> Hi Team, Please review https://review.opendev.org/c/airship/airshipctl/+/789640 - Update Validation Logic for Clusterctl Move https://review.opendev.org/c/airship/airshipctl/+/789639 - Update gcp-test-site for site validation https://review.opendev.org/c/airship/airshipctl/+/790896 - Update provider manifests for site validation These are not critical for Wharf, but needed for 2.1 release. All have zuul and att ci +114:42
airship-irc-botThanks!14:42
*** raildo has joined #airshipit15:32
*** rezroo has joined #airshipit15:37
airship-irc-bot<sirajudeen.yasin> Team, noticing strange issue with validate docs in zuul https://zuul.opendev.org/t/openstack/build/71afb23a6cd849c8b85abd7d3c82b04c https://zuul.opendev.org/t/openstack/build/04988906604041058f629328fc60c221 https://zuul.opendev.org/t/openstack/build/55cdc67c5fe14ce0aa927817cd6d837f  Seems to be intermittent and the same PS passes  validate docs after rechecks16:00
airship-irc-bot<sirajudeen.yasin> Many PSs failing validate docs with schema error and it seems to be passing after adding rechecks16:03
airship-irc-bot<raliev> it looks like issues with connectivity/availability of `kubernetesjsonschema.dev` site16:04
airship-irc-bot<raliev> we should think about mirroing this one for better reliability16:05
*** rezroo has quit IRC16:08
airship-irc-bot<ao129q> may I have another +2 here please https://review.opendev.org/c/airship/treasuremap/+/79271118:15
airship-irc-bot<dwalt> Hey all - would appreciate reviews on this small 2.1 item in Treasuremap: https://review.opendev.org/c/airship/treasuremap/+/79282818:30
airship-irc-bot<hr858f> Hi all, Could we get reviews on this: https://review.opendev.org/c/airship/treasuremap/+/789942? Thanks18:54
airship-irc-bot<hr858f> Hi, can we have another +2: https://review.opendev.org/c/airship/treasuremap/+/792711?19:04
airship-irc-bot<hr858f> @kk6740 Here's the commit that Deepak was referring: https://review.opendev.org/c/airship/treasuremap/+/792711/119:07
*** rezroo has joined #airshipit20:37
*** raildo has quit IRC21:06
airship-irc-bot<sidney.shiba> Me again with issues deploying the target cluster behind a proxy. I got access to a much bigger VM and everything was going well until reaching the deployment of Worker node. Btw, I got to the same point using an Azure VM. See traces below and hopefully someone can help identifying the issue.  `ubuntu@dex-test-vm:~$ kubectl --kubeconfig ~/.airship/kubeconfig --context target-cluster get bmh -A` `NAMESPACE   NAME     STATUS22:03
airship-irc-botPROVISIONING STATUS   CONSUMER                     BMC                                                              HARDWARE PROFILE   ONLINE   ERROR` `default     node01                                  cluster-controlplane-8zl64   redfish+http://10.23.25.1:8000/redfish/v1/Systems/air-target-1                      true`      `default     node03   OK       ready22:03
airship-irc-botredfish+http://10.23.25.1:8000/redfish/v1/Systems/air-worker-1   unknown            false`     `ubuntu@dex-test-vm:~$`  `ubuntu@dex-test-vm:~$ kubectl --kubeconfig ~/.airship/kubeconfig --context target-cluster get machines` `NAME                         PROVIDERID                                      PHASE` `cluster-controlplane-bvktf   metal3://32cb6194-cbfe-43b5-81d4-c487cb34c3cf   Running` `ubuntu@dex-test-vm:~$`  `ubuntu@dex-test-vm:~$`22:03
airship-irc-bot`ubuntu@dex-test-vm:~$ kubectl --kubeconfig ~/.airship/kubeconfig --context target-cluster get nodes` `NAME     STATUS   ROLES    AGE   VERSION` `node01   Ready    master   65m   v1.18.6` `ubuntu@dex-test-vm:~$ virsh list --all`  `Id    Name                           State` `----------------------------------------------------`  `6     air-target-1                   running`  `-     air-ephemeral                  shut off`  `-     air-worker-122:03
airship-irc-bot                  shut off`22:03
airship-irc-bot<kk6740> Did it timeout?22:05
airship-irc-bot<sidney.shiba> No, this time the script `35_deploy_worker_node.sh` just exited. See trace below:  `ubuntu@dex-test-vm:~/projects/treasuremap$ ./tools/deployment/35_deploy_worker_node.sh` `+ export KUBECONFIG=/home/ubuntu/.airship/kubeconfig` `+ KUBECONFIG=/home/ubuntu/.airship/kubeconfig` `+ export KUBECONFIG_TARGET_CONTEXT=target-cluster` `+ KUBECONFIG_TARGET_CONTEXT=target-cluster` `+ : ../airshipctl` `++ airshipctl phase render22:08
airship-irc-botworkers-target -k BareMetalHost` `++ yq .metadata.name` `++ sed 's/"//g'` `+ export WORKER_NODE=node03` `+ WORKER_NODE=node03` `+ cd ../airshipctl` `+ ./tools/deployment/35_deploy_worker_node.sh` `[airshipctl] 2021/05/24 21:47:12 opendev.org/airship/airshipctl/pkg/phase/executors/container.go:179: Config reference is specified, looking for the object in config ref:22:08
airship-irc-bot'&ObjectReference{Kind:ConfigMap,Namespace:,Name:virsh-destroy-vms,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,}'` `{"Message":"starting generic container","Operation":"GenericContainerStart","Timestamp":"2021-05-24T21:47:12.568388137Z","Type":"GenericContainerEvent"}` `[airshipctl] 2021/05/24 21:47:12 opendev.org/airship/airshipctl/pkg/container/container_docker.go:249: Image Already exists, skip download` `[airshipctl] 2021/05/24 21:47:1222:08
airship-irc-botopendev.org/airship/airshipctl/pkg/container/api.go:150: Starting container with image: 'quay.io/airshipit/toolbox-virsh:latest', cmd: '[]'` `[airshipctl] 2021/05/24 21:47:12 opendev.org/airship/airshipctl/pkg/container/api.go:165: Waiting for container run to finish, image: 'quay.io/airshipit/toolbox-virsh:latest', cmd: '[]'` `[airshipctl] 2021/05/24 21:47:12 opendev.org/airship/airshipctl/pkg/container/container_docker.go:360: waiting until22:08
airship-irc-botcommand is finished...` `[airshipctl] 2021/05/24 21:47:12 Filtering input bundle by Group: , Version: , Kind:`  `+ EPHEMERAL_DOMAIN_NAME=air-ephemeral` `+ type virsh` `+ virsh list --all --name --state-running` `+ grep air-ephemeral` `+ echo 'Stop ephemeral node '"'"'air-ephemeral'"'"` `Stop ephemeral node 'air-ephemeral'` `+ virsh destroy air-ephemeral` `Domain air-ephemeral destroyed` `[airshipctl] 2021/05/24 21:47:1322:08
airship-irc-botopendev.org/airship/airshipctl/pkg/container/api.go:258: writing container output to provided writer` `{"Message":"execution of the generic container finished","Operation":"GenericContainerStop","Timestamp":"2021-05-24T21:47:13.858675306Z","Type":"GenericContainerEvent"}` `Deploy worker node` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/phase/executors/k8s_applier.go:110: Filtering out documents that shouldn't be22:08
airship-irc-botapplied to kubernetes from document bundle` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/phase/executors/k8s_applier.go:115: Getting kubeconfig context name from cluster map` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/phase/executors/k8s_applier.go:120: Getting kubeconfig file information from kubeconfig provider` `[airshipctl] 2021/05/24 21:47:2422:08
airship-irc-botopendev.org/airship/airshipctl/pkg/k8s/kubeconfig/builder.go:260: Received error when extacting context, ignoring kubeconfig. Error: failed merging kubeconfig: source context 'target-cluster' does not exist in source kubeconfig` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/k8s/kubeconfig/builder.go:170: Merging kubecontext for cluster 'target-cluster', into site kubeconfig` `[airshipctl] 2021/05/24 21:47:2422:08
airship-irc-botopendev.org/airship/airshipctl/pkg/phase/executors/k8s_applier.go:127: Using kubeconfig at '/home/ubuntu/.airship/kubeconfig-166739077' and context 'target-cluster'` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/phase/executors/k8s_applier.go:99: WaitTimeout: 33m20s` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/k8s/applier/applier.go:74: Getting infos for bundle, inventory id is workers-target`22:08
airship-irc-bot`[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/k8s/applier/applier.go:107: Inventory Object config Map not found, auto generating Inventory object` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/k8s/applier/applier.go:114: Injecting Inventory Object:22:08
airship-irc-bot{"apiVersion":"v1","kind":"ConfigMap","metadata":{"creationTimestamp":null,"labels":{"cli-utils.sigs.k8s.io/inventory-id":"workers-target"},"name":"airshipit-workers-target","namespace":"airshipit"}}{nsfx:false,beh:unspecified} into bundle` `[airshipctl] 2021/05/24 21:47:24 opendev.org/airship/airshipctl/pkg/k8s/applier/applier.go:120: Making sure that inventory object namespace airshipit exists` `secret/node03-bmc-secret created`22:08
airship-irc-bot`secret/node03-network-data created` `baremetalhost.metal3.io/node03 created` `3 resource(s) applied. 3 created, 0 unchanged, 0 configured` `secret/node03-bmc-secret is NotFound: Resource not found` `secret/node03-network-data is NotFound: Resource not found` `baremetalhost.metal3.io/node03 is NotFound: Resource not found` `secret/node03-bmc-secret is Current: Resource is always ready` `secret/node03-network-data is Current: Resource is always22:08
airship-irc-botready` `baremetalhost.metal3.io/node03 is Current: Resource is current` `{"Message":"starting generic container","Operation":"GenericContainerStart","Timestamp":"2021-05-24T21:47:37.574115269Z","Type":"GenericContainerEvent"}` `[airshipctl] 2021/05/24 21:47:37 opendev.org/airship/airshipctl/pkg/k8s/kubeconfig/builder.go:260: Received error when extacting context, ignoring kubeconfig. Error: failed merging kubeconfig: source context22:08
airship-irc-bot'target-cluster' does not exist in source kubeconfig` `[airshipctl] 2021/05/24 21:47:37 opendev.org/airship/airshipctl/pkg/k8s/kubeconfig/builder.go:170: Merging kubecontext for cluster 'target-cluster', into site kubeconfig` `[airshipctl] 2021/05/24 21:47:37 opendev.org/airship/airshipctl/pkg/phase/executors/container.go:179: Config reference is specified, looking for the object in config ref:22:08
airship-irc-bot'&ObjectReference{Kind:ConfigMap,Namespace:,Name:kubectl-wait-bmh,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,}'` `[airshipctl] 2021/05/24 21:47:37 opendev.org/airship/airshipctl/pkg/container/container_docker.go:249: Image Already exists, skip download` `[airshipctl] 2021/05/24 21:47:37 opendev.org/airship/airshipctl/pkg/container/api.go:150: Starting container with image: 'quay.io/airshipit/toolbox:latest', cmd: '[]'` `[airshipctl]22:08
airship-irc-bot2021/05/24 21:47:37 opendev.org/airship/airshipctl/pkg/container/api.go:165: Waiting for container run to finish, image: 'quay.io/airshipit/toolbox:latest', cmd: '[]'` `[airshipctl] 2021/05/24 21:47:37 opendev.org/airship/airshipctl/pkg/container/container_docker.go:360: waiting until command is finished...` `[airshipctl] 2021/05/24 21:47:37 Filtering input bundle by Group: metal3.io, Version: v1alpha1, Kind: BareMetalHost` `+ export22:08
airship-irc-bot'TIMEOUT=3600'` `+ kubectl --context target-cluster get -f /tmp/bundle.yaml --output 'jsonpath={..metadata.name}'` `+ WORKER_NODE=` `+ echo 'Wait 3600 seconds for BMH to be in ready state.'` `Wait 3600 seconds for BMH to be in ready state.` `+ date '+%s'` `+ end=1621896457` `[airshipctl] 2021/05/24 21:47:38 opendev.org/airship/airshipctl/pkg/container/api.go:258: writing container output to provided writer` `{"Message":"execution of the22:08
airship-irc-botgeneric container finished","Operation":"GenericContainerStop","Timestamp":"2021-05-24T21:47:38.608846793Z","Type":"GenericContainerEvent"}` `{"Message":"starting generic container","Operation":"GenericContainerStart","Timestamp":"2021-05-24T21:47:49.454606314Z","Type":"GenericContainerEvent"}` `[airshipctl] 2021/05/24 21:47:49 opendev.org/airship/airshipctl/pkg/k8s/kubeconfig/builder.go:260: Received error when extacting context, ignoring22:08
airship-irc-bot<kk6740> is this TM or airshipctl test site?22:09
airship-irc-bot<sidney.shiba> TM22:11
airship-irc-bot<kk6740> can u do `airshipctl phase list`22:17
airship-irc-bot<kk6740> i think in TM a phase controlplane-workers is missing correct condes22:19
airship-irc-bot<sidney.shiba> `ubuntu@dex-test-vm:~$ airshipctl phase list` `NAMESPACE   RESOURCE                                  CLUSTER NAME          EXECUTOR              DOC ENTRYPOINT`                                                                                                   `Phase/clusterctl-init-ephemeral           ephemeral-cluster     Clusterctl`22:19
airship-irc-bot                           `Phase/clusterctl-init-target              target-cluster        Clusterctl`                                                                                                                             `Phase/clusterctl-move                     target-cluster        Clusterctl`22:19
airship-irc-bot`Phase/controlplane-ephemeral              ephemeral-cluster     KubernetesApply       ephemeral/controlplane`                                                                                           `Phase/controlplane-target                 target-cluster        KubernetesApply       target/controlplane`                                                                                              `Phase/ephemeral-az-cleanup22:19
airship-irc-bot                   BootConfiguration`                                                                                                                      `Phase/ephemeral-az-genesis                                      BootConfiguration`                                                                                                                      `Phase/ephemeral-gcp-cleanup                                     BootConfiguration`22:19
airship-irc-bot                                                                                                             `Phase/ephemeral-gcp-genesis                                     BootConfiguration`                                                                                                                      `Phase/ephemeral-os-cleanup                                      BootConfiguration`22:19
airship-irc-bot                                                               `Phase/ephemeral-os-genesis                                      BootConfiguration`                                                                                                                      `Phase/initinfra-ephemeral                 ephemeral-cluster     KubernetesApply       ephemeral/initinfra`22:19
airship-irc-bot                 `Phase/initinfra-networking-ephemeral      ephemeral-cluster     KubernetesApply       ephemeral/initinfra-networking`                                                                                   `Phase/initinfra-networking-target         target-cluster        KubernetesApply       target/initinfra-networking`                                                                                      `Phase/initinfra-target22:19
airship-irc-bot              target-cluster        KubernetesApply       target/initinfra`                                                                                                 `Phase/iso-build-image                                           GenericContainer`                                                                                                                       `Phase/iso-cloud-init-data22:19
airship-irc-botGenericContainer      ephemeral/bootstrap`                                                                                              `Phase/kubectl-get-node-target             target-cluster        GenericContainer`                                                                                                                       `Phase/kubectl-get-pods-ephemeral          ephemeral-cluster     GenericContainer`22:19
airship-irc-bot                                                                                          `Phase/kubectl-get-pods-target             target-cluster        GenericContainer`                                                                                                                       `Phase/kubectl-pause-bmh                   ephemeral-cluster     GenericContainer      ephemeral/controlplane`22:19
airship-irc-bot                                            `Phase/kubectl-wait-bmh-target             target-cluster        GenericContainer      target/workers`                                                                                                   `Phase/kubectl-wait-cluster-target         target-cluster        GenericContainer      ephemeral/controlplane`22:19
airship-irc-bot`Phase/kubectl-wait-deploy-ephemeral       ephemeral-cluster     GenericContainer`                                                                                                                       `Phase/kubectl-wait-label-node-target      target-cluster        GenericContainer      target/workers`                                                                                                   `Phase/kubectl-wait-node-ephemeral22:19
airship-irc-botephemeral-cluster     GenericContainer`                                                                                                                       `Phase/kubectl-wait-pods-target            target-cluster        GenericContainer`                                                                                                                       `Phase/kubectl-wait-tigera-ephemeral       ephemeral-cluster     GenericContainer`22:19
airship-irc-bot                                                                                                                `Phase/kubectl-wait-tigera-target          target-cluster        GenericContainer`                                                                                                                       `Phase/lma-configs                         target-cluster        KubernetesApply       target/lma-configs`22:19
airship-irc-bot                                                                  `Phase/lma-infra                           target-cluster        KubernetesApply       target/lma-infra`                                                                                                 `Phase/lma-stack                           target-cluster        KubernetesApply       target/lma-stack`22:19
airship-irc-bot                    `Phase/remotedirect-ephemeral                                    BaremetalManager`                                                                                                                       `Phase/secret-generate                                           GenericContainer      target/encrypted/generator`                                                                                       `Phase/secret-import22:19
airship-irc-bot                                       GenericContainer      target/encrypted/importer`                                                                                        `Phase/secret-reencrypt                                          GenericContainer      target/encrypted/results`                                                                                         `Phase/secret-show22:19
airship-irc-botGenericContainer      target/encrypted/results`                                                                                         `Phase/virsh-destroy-vms                                         GenericContainer`                                                                                                                       `Phase/virsh-eject-cdrom-images                                  GenericContainer`22:19
airship-irc-bot<kk6740> ok, can u do `airshipctl phase render workers-target`22:20
airship-irc-bot<sidney.shiba> `ubuntu@dex-test-vm:~$ airshipctl phase render workers-target` `---` `apiVersion: v1` `data:`   `password: cGFzc3dvcmQ=`   `username: dXNlcm5hbWU=` `kind: Secret` `metadata:`   `annotations:`     `config.kubernetes.io/path: secret_node03-bmc-secret.yaml`   `labels:`     `airshipit.org/k8s-role: controlplane-host`   `name: node03-bmc-secret` `type: Opaque` `...` `---` `apiVersion: v1` `kind: Secret` `metadata:`   `annotations:`22:23
airship-irc-bot  `config.kubernetes.io/path: secret_node03-network-data.yaml`   `labels:`     `airshipit.org/k8s-role: controlplane-host`   `name: node03-network-data` `stringData:`   `networkData: "links:\n-\n  id: oam\n  mtu: \"1500\"\n  name: oam\n  type: phy\n  \n  ethernet_mac_address: 52:54:00:9b:27:07\n-\n  id: pxe\n  mtu: \"1500\"\n  name: pxe\n  type: phy\n  \n  ethernet_mac_address: 52:54:00:b6:ed:23\nnetworks:\n-\n  id: oam-ipv4\n  link: oam\n22:23
airship-irc-botnetmask: 255.255.255.0\n  routes:\n    - gateway: 10.23.25.1\n      netmask: 0.0.0.0\n      network: 0.0.0.0\n  type: ipv4\n  \n  ip_address: 10.23.25.103\n-\n  id: pxe-ipv4\n  link: pxe\n  netmask: 255.255.255.0\n  type: ipv4\n  \n  ip_address: 10.23.24.103\nservices:\n  - address: 135.37.9.16\n    type: dns\n  - address: 135.38.244.16\n    type: dns\n  \n"` `type: Opaque` `...` `---` `apiVersion: metal3.io/v1alpha1` `kind: BareMetalHost`22:23
airship-irc-bot`metadata:`   `annotations:`     `config.kubernetes.io/path: baremetalhost_node03.yaml`   `labels:`     `airshipit.org/k8s-role: controlplane-host`   `name: node03` `spec:`   `bmc:`     `address: redfish+http://10.23.25.1:8000/redfish/v1/Systems/air-worker-1`     `credentialsName: node03-bmc-secret`     `disableCertificateVerification: false`   `bootMACAddress: 52:54:00:b6:ed:23`   `bootMode: UEFI`   `firmware:`22:23
airship-irc-bot`simultaneousMultithreadingDisabled: false`     `sriovEnabled: false`     `virtualizationDisabled: false`   `networkData:`     `name: node03-network-data`     `namespace: default`   `online: false` `...`22:23
airship-irc-bot<kk6740> is it test-site from TM?22:27
airship-irc-bot<sidney.shiba> yes22:27
airship-irc-bot<kk6740> can u rerun 35 script and see what happens, also if possible could u paste these logs in paste bin? hard to read here22:28
airship-irc-bot<sidney.shiba>22:33
airship-irc-bot<sidney.shiba> @kk6740 did you find anything that could explain why worker nodes are not created?23:11
airship-irc-bot<kk6740> sorry, i didnt have time to look into it. i’ll take a look tomorrow morning23:26
airship-irc-bot<ao129q> @sidney.shiba which airshipctl and tm commits do you use?23:27
airship-irc-bot<ao129q> workers-classification was recently removed from airshipctl23:28
airship-irc-bot<ao129q> so everything must be included in workers-target23:28
airship-irc-bot<sidney.shiba> latest cloned this morning23:28
airship-irc-bot<ao129q> thus you need to include 'provision' into your workers/kustomization.yaml23:28
airship-irc-bot<sidney.shiba> meaning?23:29
airship-irc-bot<ao129q> ```resources:   - nodes   - provision```23:30
airship-irc-bot<ao129q> if you have a separate dir for provision stuff23:30
airship-irc-bot<sidney.shiba> Btw, shouldn't all this be already in the master repo? I am not familiar with this provision stuff.23:31
airship-irc-bot<ao129q> we pin airshipctl revision in tm, so in gates it's probably using an older one that has workers-classification phase23:32
airship-irc-bot<ao129q> when airshipctl revision is updated in tm also provision stuff must be included to kustomization.yaml of workers-target phase23:32
airship-irc-bot<ao129q> but if you have master airshipctl and master tm - i see how you have this issue23:33
airship-irc-bot<ao129q> hopefully it's all you need to do locally - add provision23:33
airship-irc-bot<ao129q> or roll back to airshipctl revision that is pinned in current tm master23:33
airship-irc-bot<sidney.shiba> I don't know what this *provision* is so not sure what I have to do. I guess I need instructions to understand how these two repos (airshipctl and treasuremap) work together in relation with merges. I was naive enough to believe that merged airshipctl and treasuremap would work as it is.23:36
airship-irc-bot<ao129q> they don't23:36
airship-irc-bot<sidney.shiba> That's new for me. I guess we need some release notes on this. Where do I find which airshipctl I have to clone so I can test my treasuremap stuff?23:39
airship-irc-bot<ao129q> https://opendev.org/airship/treasuremap/src/branch/master/zuul.d/projects.yaml#L1723:40
airship-irc-bot<ao129q> this what tm currently use23:40
airship-irc-bot<ao129q> in zuul jobs23:41
airship-irc-bot<sidney.shiba> Thanks for the info. Will try it tomorrow.23:42
airship-irc-bot<ao129q> yw :slightly_smiling_face:23:43
*** openstack has joined #airshipit23:48
*** ChanServ sets mode: +o openstack23:48

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!