Friday, 2020-02-07

openstackgerritJulia Kreger proposed openstack/ironic master: Add indicators REST API endpoints  https://review.opendev.org/65178500:12
openstackgerritJulia Kreger proposed openstack/ironic master: Add api history note for 1.60  https://review.opendev.org/70641400:12
openstackgerritJulia Kreger proposed openstack/ironic master: Hash the rescue_password  https://review.opendev.org/69141300:21
openstackgerritJulia Kreger proposed openstack/ironic master: Hash the rescue_password  https://review.opendev.org/69141300:21
openstackgerritMerged openstack/ironic master: Disable debug output in doc building  https://review.opendev.org/70622000:22
openstackgerritJulia Kreger proposed openstack/ironic master: Add indicators REST API endpoints  https://review.opendev.org/65178500:28
openstackgerritJulia Kreger proposed openstack/ironic master: Add agent_token api version history update  https://review.opendev.org/70641600:33
*** k_mouza has quit IRC00:41
*** k_mouza has joined #openstack-ironic00:43
*** TxGirlGeek has quit IRC00:52
TheJuliaIs anyone still interested in a single process ironic? Kaifeng brought up a good point that jsonrpc could now be used to remove the objectional fake rpc transport usage.00:55
JayFyou mean conductor and api in a single process?00:58
*** bobmel has joined #openstack-ironic00:58
TheJuliayeah01:01
*** bobmel has quit IRC01:03
JayFI suspect I know so little about that use case my input might not be valuable01:03
JayFbut this seems like that's an option that could setup deployers to make bad design decisions01:03
*** dsneddon has quit IRC01:03
JayFi.e. putting their IPMI interfaces on a network that's not restricted from (more) public-facing API servers01:03
TheJuliaThis is a valid point01:05
* TheJulia goes and abandons the poc patch01:06
JayFand the other cases where it's (obviously) useful is stuff like devstack... where I'd argue we *should explicitly test* the interprocess communication01:06
JayFthe only case where that could be cool01:06
JayFis combined with bifrost for a server-provisioning-appliance01:06
JayFbut I know next to nothing about user cases for that sorta product, so all I see are the downsides for giant installs :P01:06
TheJuliaNobodyCam: any objection if I abandon 413249 ?01:18
openstackgerritJulia Kreger proposed openstack/ironic master: Add a locking interface  https://review.opendev.org/59919101:19
NobodyCamLol I totally forgot about that one01:22
NobodyCamYea I not working on it01:23
*** Lucas_Gray has quit IRC01:32
*** dsneddon has joined #openstack-ironic01:38
*** gyee has quit IRC02:03
*** k_mouza has quit IRC02:11
*** dsneddon has quit IRC02:14
*** rh-jelabarre has quit IRC02:21
*** Goneri has quit IRC02:26
*** rloo has quit IRC02:35
*** dsneddon has joined #openstack-ironic02:48
*** dsneddon has quit IRC02:53
*** mkrai has joined #openstack-ironic03:12
*** tzumainn has quit IRC04:21
*** bobmel has joined #openstack-ironic04:31
*** dsneddon has joined #openstack-ironic04:49
*** dsneddon has quit IRC04:54
*** dsneddon has joined #openstack-ironic04:57
*** bobmel has quit IRC05:01
*** dsneddon has quit IRC05:02
*** gkaratae has joined #openstack-ironic05:23
*** ociuhandu has joined #openstack-ironic05:53
*** ociuhandu has quit IRC05:57
*** Lucas_Gray has joined #openstack-ironic06:31
*** dsneddon has joined #openstack-ironic06:58
*** dsneddon has quit IRC07:04
*** ricolin has quit IRC07:11
*** Lucas_Gray has quit IRC07:13
*** Lucas_Gray has joined #openstack-ironic07:14
arne_wiebalckGood morning, ironic!07:24
*** dtantsur|afk is now known as dtantsur07:27
dtantsurmorning ironic07:28
*** dsneddon has joined #openstack-ironic07:29
dtantsurcan someone please check https://review.opendev.org/#/c/706250/ and https://review.opendev.org/#/c/706258/ ?07:30
patchbotpatch 706250 - ironic - Split deployment-related functions from manager.py... - 1 patch set07:30
patchbotpatch 706258 - ironic - Split cleaning-related functions from manager.py i... - 1 patch set07:30
dtantsurthey look scary, but actually just moving code around07:30
*** dsneddon has quit IRC07:34
jlvillaldtantsur, Good morning :)07:42
dtantsurhey-hey jlvillal, long time no see :) how are you?07:47
jlvillaldtantsur, I'm doing well. Actually in Moscow at the moment. Your old stomping grounds :)07:47
*** Lucas_Gray has quit IRC07:52
jlvillalI hope all is going well with you!07:55
*** Lucas_Gray has joined #openstack-ironic07:56
dtantsuryeah, I'm good. haven't been in Moscow for a while :)07:57
dtantsurjlvillal: are you doing something ironic nowadays?07:58
jlvillaldtantsur, Not really. I'm doing some bare-metal stuff part time at the moment.07:58
jlvillaldtantsur, Some Beaker work :)07:58
dtantsurnice :)07:58
jlvillalSo another Red Hat related project.07:59
dtantsurI know some people in RH are trying ironic instead of/as a backend of beaker07:59
jlvillalCool. Though beaker does kickstart installs, where Ironic does image based installs. Unless something has changed.07:59
dtantsurI think it's still true08:01
jlvillaldtantsur, You should check out Moscow again. Still pretty cool :)08:03
jlvillalI went to the ДЕПО food mall yesterday. Nice place.08:07
*** amoralej|off is now known as amoralej08:09
*** bobmel has joined #openstack-ironic08:10
*** rpittau|afk is now known as rpittau08:10
rpittaugood morning ironic! o/08:10
rpittauHappy Friday! :)08:10
*** tkajinam has quit IRC08:12
*** bobmel has quit IRC08:14
*** jerrywang1 has joined #openstack-ironic08:17
*** Lucas_Gray has quit IRC08:17
*** iurygregory has joined #openstack-ironic08:19
iurygregorygood morning everyone o/08:19
*** Lucas_Gray has joined #openstack-ironic08:22
rpittauhey iurygregory :)08:23
iurygregoryrpittau, o/08:25
jerrywang1morning everyone o/08:26
iurygregorymorning jerrywang108:26
rpittauhey jerrywang1 :)08:30
*** tesseract has joined #openstack-ironic08:36
openstackgerritKaifeng Wang proposed openstack/ironic master: [WIP] Automatic port allocation for the serial console  https://review.opendev.org/70644508:40
openstackgerritMerged openstack/ironic-python-agent-builder master: Revert "Test artifact publishing via AFS"  https://review.opendev.org/70516108:40
*** khansa has joined #openstack-ironic08:43
*** bobmel has joined #openstack-ironic08:55
*** k_mouza has joined #openstack-ironic09:00
*** gudrutis2 has joined #openstack-ironic09:03
*** mbeierl1 has joined #openstack-ironic09:03
*** mbeierl has quit IRC09:04
*** mbeierl1 is now known as mbeierl09:04
*** k_mouza has quit IRC09:05
*** bobmel has quit IRC09:06
*** dougsz has joined #openstack-ironic09:06
*** lucasagomes has joined #openstack-ironic09:10
dtantsurjlvillal: I don't know this chain :) Granted, I haven't lived in Russia for 6 years :)09:18
* dtantsur is in Düsseldorf nowadays09:19
jlvillaldtantsur, They converted an old tram depot into a pretty large food mall. About 200 restaurants.09:21
jlvillaldtantsur, Oh you moved. I thought you used to be in Berlin.09:22
* jlvillal will be in Belgium in about two weeks09:22
etingofjlvillal, where is that дело place?09:27
jlvillaletingof, Address: Lesnaya Ulitsa, 20 стр.3, Moscow, 12504709:27
jlvillaletingof, https://www.themoscowtimes.com/2019/03/15/travel-the-world-with-your-taste-buds-at-depo-a6480909:28
jlvillalAnd if you read Russian: https://depomoscow.ru/09:28
etingofjlvillal, thanks! I like these old cars. Though I guess the smell of old machinery is gone09:29
jlvillaletingof, Yeah I didn't smell any old machinery ;)09:29
*** dsneddon has joined #openstack-ironic09:30
* etingof used to work at a depot as a teenager09:31
jlvillaletingof, Cool! :)09:31
*** khansa has quit IRC09:32
*** k_mouza has joined #openstack-ironic09:32
etingofit was the other way round back then - lots of greasy, hot and heavy machinery all around, and just one canteen somewhere on the side09:33
*** khansa has joined #openstack-ironic09:34
etingofalso, we did not have unit tests back then - life used to be much more straightforward and less surprising09:34
jlvillalSounds barbaric! ;)09:36
*** dsneddon has quit IRC09:40
* etingof suspects they still do not have unit tests at that депо. they use jlvillal for food testing09:40
jlvillalheh09:41
arne_wiebalckrpittau: Totally possible our image is causing the issue I see in (https://review.opendev.org/#/c/696156/)09:45
patchbotpatch 696156 - ironic-python-agent - Software RAID: make it bootable with uefi - 2 patch sets09:45
*** ociuhandu has joined #openstack-ironic09:45
arne_wiebalckrpittau: I am also somewhat confused why this worked before ... seems like this patch relies on mdadm in a different way than the code before.09:46
*** derekh has joined #openstack-ironic09:46
arne_wiebalckrpittau: Maybe it is not mdadm, but sth else.09:47
rpittauarne_wiebalck: ah maybe yeah, I mean it's safer to add /sbin anyway, just double-check the image09:47
arne_wiebalckrpittau: The patch amends PATH already for other things, but I guess this is for a Ubuntu based IPA image.09:48
arne_wiebalckrpittau: So maybe the same requirements are in another place in CentoS ...09:49
rpittauarne_wiebalck: I have suspects on chroot09:51
* iurygregory hopes it doesn't need grub2 ^ since we did a lot of changes for uefi XD09:51
arne_wiebalckrpittau: could be as wekk09:51
arne_wiebalckwell09:51
*** ociuhandu has quit IRC09:51
arne_wiebalckrpittau: anyway it should not hurt to add /sbin, I guess?09:52
arne_wiebalckrpittau: and that seems to make things work in my tests09:52
arne_wiebalckrpittau: I cannot test much more at the moment since the node is needed for sth else ...09:53
arne_wiebalckiurygregory: not sure how your changes mix with these, yes ... I guess we will find out during the rebasing ...09:53
rpittauarne_wiebalck: absolutely not, if it's there already it will just be duplicated, or we can modify the mechanism to add it there if it's not, but maybe in a followup09:53
iurygregoryarne_wiebalck, some changes in the install_bootloader function etc XD09:54
arne_wiebalckiurygregory: yep, that's very close ... let's see :)10:00
*** ociuhandu has joined #openstack-ironic10:02
*** alexmcleod has joined #openstack-ironic10:07
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add systems, managers and chassis listing commands  https://review.opendev.org/70646110:15
dtantsurjlvillal: oh, so it's more of an event place rather than a simple mall10:20
dtantsurand yes, I moved to Düsseldorf in November10:21
jlvillaldtantsur, Well it is a big building. And there are all these restaurants that you can go up and order food. Then there is unassigned seating. So no waiters or specific tables for any restaurant.10:22
jlvillalKind of like a food court at the mall in the US.10:22
jlvillaldtantsur, Congrats. I hope you are liking it there :)10:22
dtantsura lot :)10:22
jlvillalNice :)10:24
*** ajya[m] has quit IRC10:27
*** mkowalski has quit IRC10:27
openstackgerritMerged openstack/ironic master: Split deployment-related functions from manager.py into a new module  https://review.opendev.org/70625010:32
*** gkaratae has quit IRC10:36
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Workaround for Python virtualenv  https://review.opendev.org/70506010:37
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Use train branch for centos7 job  https://review.opendev.org/70629210:38
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Force DIB_PYTHON_VERSION to 3 for Debian  https://review.opendev.org/70577310:44
*** priteau has joined #openstack-ironic10:46
*** khansa has quit IRC10:50
openstackgerritMerged openstack/bifrost master: Sync pip_install files  https://review.opendev.org/70350210:51
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Use openstacksdk for ironic module  https://review.opendev.org/67217910:59
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add system/manager/chassis inventory show command  https://review.opendev.org/70600511:09
openstackgerritMerged openstack/ironic master: Allow node owners to administer associated ports  https://review.opendev.org/69525511:14
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add system/manager/chassis inventory show command  https://review.opendev.org/70600511:17
*** rpittau is now known as rpittau|bbl11:18
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add systems, managers and chassis listing commands  https://review.opendev.org/70646111:18
*** mkrai has quit IRC11:31
*** dsneddon has joined #openstack-ironic11:36
*** dsneddon has quit IRC11:41
*** mkowalski has joined #openstack-ironic12:05
*** ajya[m] has joined #openstack-ironic12:05
*** mkrai has joined #openstack-ironic12:10
openstackgerritMerged openstack/ironic master: Split cleaning-related functions from manager.py into a new module  https://review.opendev.org/70625812:12
openstackgerritMerged openstack/ironic master: Remove references to 'firewall_driver'  https://review.opendev.org/69653512:12
*** ociuhandu has quit IRC12:27
*** ociuhandu has joined #openstack-ironic12:28
*** mkrai has quit IRC12:36
*** k_mouza has quit IRC12:39
*** k_mouza_ has joined #openstack-ironic12:39
*** Wryhder has joined #openstack-ironic12:42
*** ociuhandu has quit IRC12:42
*** Lucas_Gray has quit IRC12:43
*** Wryhder is now known as Lucas_Gray12:43
*** Lucas_Gray has quit IRC12:49
*** Lucas_Gray has joined #openstack-ironic13:01
*** jtomasek_ has joined #openstack-ironic13:04
*** jtomasek has quit IRC13:06
*** ociuhandu has joined #openstack-ironic13:08
*** rh-jelabarre has joined #openstack-ironic13:08
*** jtomasek_ has quit IRC13:08
*** jtomasek has joined #openstack-ironic13:09
*** rpittau|bbl is now known as rpittau13:14
*** dsneddon has joined #openstack-ironic13:15
*** dtantsur is now known as dtantsur|brb13:26
*** Lucas_Gray has quit IRC13:28
*** Lucas_Gray has joined #openstack-ironic13:29
*** rloo has joined #openstack-ironic13:33
*** rloo has quit IRC13:33
*** rloo has joined #openstack-ironic13:33
*** aedc has joined #openstack-ironic13:34
*** gmann_ has joined #openstack-ironic13:40
*** gmann_ is now known as gmann13:40
*** gmann has quit IRC13:40
*** gmann has joined #openstack-ironic13:41
openstackgerritArne Wiebalck proposed openstack/ironic master: [Trivial] Remove redundant brackets  https://review.opendev.org/70651313:50
*** aedc has quit IRC14:00
*** amoralej is now known as amoralej|lunch14:07
*** jdandrea has joined #openstack-ironic14:10
*** dsneddon has quit IRC14:18
TheJuliaguten morgan14:18
TheJuliajlvillal: o/14:18
*** tesseract-RH has joined #openstack-ironic14:19
arne_wiebalckTheJulia: German?14:20
TheJuliaarne_wiebalck: my limited, uncaffinated recall of german without accented characters because I'm lame and still waking up14:20
iurygregorygood morning TheJulia o/14:20
*** tesseract has quit IRC14:21
dtantsur|brbmorning TheJulia, this doesn't require accented characters (although it's Morgen) :)14:24
* dtantsur|brb is still fighting headache, so staying brb14:24
arne_wiebalckI  was about to say this, but I wanted to see how German dtantsur|brb is meanwhile :-D14:24
TheJulialovely... huge merge conflicts14:26
rpittaugood morning TheJulia, I have Python versions conflicts, want to swap? :D14:27
TheJulianope14:28
*** jerrywang1 has quit IRC14:28
TheJuliawith how difficult it has been to get any reviews for agent token, I need every active core that might be willing to review it14:29
*** aedc has joined #openstack-ironic14:31
TheJuliamaybe we could wait until the end of cycle before moving huge chunks of code around?14:32
TheJuliaor beginning of cycle?14:33
*** aedc has quit IRC14:34
*** aedc has joined #openstack-ironic14:34
*** tesseract has joined #openstack-ironic14:34
rpittauTheJulia: I guess beginning of cycle makes sense, anything specific in mind?14:34
*** Lucas_Gray has quit IRC14:35
*** Lucas_Gray has joined #openstack-ironic14:35
*** ociuhandu has quit IRC14:35
TheJuliawell, a few thousand lines have been shuffled  meaning I basically need to revert files to HEAD on a rebase conflict and completely start over14:36
TheJuliathe merge conflict diff is 2221 lines14:36
rpittauTheJulia: we could revert the shuffle, since it's just a shuffle14:36
rpittauTheJulia: btw, sorry, didn't think about that, I understand what you're talking about :/14:37
TheJuliamaybe it won't be that bad, but it is extremely frustrating considering I've had these patches up in review and passing for a while.14:38
TheJuliadamage is done, although no compatability was left it looks like for non-private methodes moved14:40
TheJuliaat least, I see do_node_deploy compeltely gone instead of mapped over14:40
rpittauTheJulia: I don't think would be bad reverting that shuffle, reviewing your agent token, and then do the shuffle back14:40
* arne_wiebalck wonders how the test pass with a function gone14:41
*** tzumainn has joined #openstack-ironic14:42
*** aedc has quit IRC14:42
TheJuliaarne_wiebalck: I'm guessing tests changed, but should somebody have been calling do_node_deploy via different means, then it is a breaking release14:42
*** tesseract has quit IRC14:43
*** tesseract-RH has quit IRC14:43
TheJuliarpittau: doesn't make much sense to.. hopefully I can just start over and cut/paste the code into the right places14:43
rpittaummm ok14:43
* TheJulia goes and prepares for first meeting14:44
*** tesseract has joined #openstack-ironic14:44
arne_wiebalckTheJulia: yes14:45
*** amoralej|lunch is now known as amoralej14:56
*** Goneri has joined #openstack-ironic14:57
openstackgerritMerged openstack/ironic master: Fix ipxe interface to perform ipxe boot without ipxe_enabled enabled  https://review.opendev.org/69763415:02
* rpittau tea time15:04
*** rpittau is now known as rpittau|brb15:04
openstackgerritVerification of a change to openstack/ironic failed: Fix bash comparisons for grenade multinode switch  https://review.opendev.org/70581415:10
*** Lucas_Gray has quit IRC15:14
*** ociuhandu has joined #openstack-ironic15:15
rpiosoGood morning, ironic15:16
*** ociuhandu has quit IRC15:16
*** ociuhandu has joined #openstack-ironic15:17
rpiosoetingof: I tried a Redfish vmedia boot deployment with tinyipa -- UEFI / local / partition.15:17
openstackgerritMerged openstack/python-ironicclient master: Add support for retired{_reason} fields.  https://review.opendev.org/70398215:17
* etingof is all ears15:17
rpiosoetingof: It failed  :(15:17
rpiosoERROR ironic.drivers.modules.agent_base_vendor [None req-8a570968-ea4f-445f-8bca-7a084905f4b4 None None] Failed to install a bootloader when deploying node f497505e-dbc1-4b91-b269-99db6c889022. Error: {'type': 'CommandExecutionError', 'code': 500, 'message': 'Command execution failed', 'details': "Could not verify uefi on device /dev/sdafailed with Unexpected error while running command.\nCommand: mount15:17
rpioso/dev/sda1 /tmp/tmpdyap7ltp/boot/efi\nExit code: 32\nStdout: ''\nStderr: 'mount: /tmp/tmpdyap7ltp/boot/efi: /dev/sda1 is not a valid block device.\\n'."}15:17
etingofmight be Friday, what else?15:18
iurygregorymorning rpioso15:19
TheJuliarpioso: what did you try to deploy?15:19
rpiosoetingof: The hardware was prepped in the same manner as it was for two immediately preceding successful tests -- UEFI / netboot / partition and UEFI / local / whole15:19
rpiosoTheJulia: RDO overcloud15:20
iurygregorythis message seems to be the one I added in the efi changes15:20
TheJuliaits a partition image I believe15:20
rpiosoTheJulia: Yep15:20
rpiosoiurygregory: Good Friday morning :)15:20
*** rpittau|brb is now known as rpittau15:20
TheJulianot a valid block device...15:21
* rpioso wonders if that error message was a wakeup call from iurygregory15:21
iurygregoryhttps://github.com/openstack/ironic-python-agent/blob/5b116042885e7d12696435e522e92d0ecedcc466/ironic_python_agent/extensions/image.py#L30215:21
iurygregoryif is a partition image something on the workflow is crazy .-.15:21
iurygregorythis would be for wholedisk images...15:21
rpiosoTheJulia: Why would that not have been the case for the successful UEFI / local / whole deployment?15:22
rpiosoThe baremetal has been prepared before each test in the same manner.15:22
TheJuliarpioso: do you have deployment logs from the ipa image or screen shot, or something?15:23
etingofif I were in rpioso's shoes, I'd flip the node into maintenance, log from console and look around. especially at /dev/sda115:23
rpiosoiurygregory: It is a partition image. No doubt about that.15:24
etingofregardless of the image flavor, non-block /dev/sda1 is indeed surprising15:24
etingofis it a tape drive you have there?15:25
rpiosoTheJulia: I haven't been able to obtain IPA logs from my devstack integration test environment. Perhaps local.conf needs further tweaking.15:25
TheJuliawe need to figure out where in this block of code things are going sideways15:26
TheJuliahttps://github.com/openstack/ironic-python-agent/blob/5b116042885e7d12696435e522e92d0ecedcc466/ironic_python_agent/extensions/image.py#L264-L30115:26
TheJulialargely because I think the issue is we're not finding any bootloaders15:26
TheJulianor folders15:26
rpiosoetingof: It's a Dell EMC BOSS card: https://i.dell.com/sites/doccontent/shared-content/data-sheets/en/Documents/Dell-PowerEdge-Boot-Optimized-Storage-Solution.pdf15:27
TheJuliaand we should kind of gracefully exit to let the bootloader install15:27
etingofcan this BOSS device not be recognized by the kernel?15:28
TheJuliarpioso:  we need the agent log to figure this out.15:28
rpiosoetingof: It was used for the other five (5) successful cases.15:28
etingofwith the same kernel?15:28
rpiosoAnd it's part of our JetStream OSP-based solution.15:28
rpiosoetingof: Three successful case were against legacy BIOS and two against UEFI.15:29
rpiosoetingof: Yes, same IPA ramdisk kernel.15:30
rpiosoetingof: Well, it's been the same for all tests against a boot mode. I used the RDO IPA against legacy BIOS. I'm using tinyipa against UEFI.15:31
etingofyeah, then BOSS is likely getting recognition15:31
rpiosoTheJulia: Any suggestions on how to get that log?15:31
rpiosoNote that I haven't gotten a single successful UEFI / local / partition Redfish vmedia deployment.15:32
*** ociuhandu_ has joined #openstack-ironic15:33
etingofif you log into live ramdisk, the logs will be there as well15:34
TheJulia rpioso deploy_logs_collect is always with devstack unless overridden15:36
TheJuliaso logs should be in /var/log/ironic/deploy, maybe ironic can't write to that folder?15:36
*** ociuhandu has quit IRC15:37
*** igordc has joined #openstack-ironic15:37
*** ociuhandu_ has quit IRC15:40
* rpioso checks ...15:42
*** ociuhandu has joined #openstack-ironic15:42
rpiosoTheJulia:15:44
rpiosoroot@devstack-ubuntu-server-18-04-3:/var/log# ls ironic15:45
rpiosols: cannot access 'ironic': No such file or directory15:45
rpiosoroot@devstack-ubuntu-server-18-04-3:/var/log# ls -ld .15:45
rpiosodrwxrwxr-x 15 root syslog 4096 Feb  7 06:25 .15:45
rpiosoroot@devstack-ubuntu-server-18-04-3:/var/log#15:45
TheJuliawell make the folder, make it writable by the user ironic-conductor runs as, and redeploy15:45
*** Goneri has quit IRC15:46
rpiosoTheJulia: Out of curiosity, does stack.sh not do that?15:46
rpiosoOr more accurately our ironic devstack plugin?15:46
*** ociuhandu has quit IRC15:47
TheJuliahttps://github.com/openstack/ironic/blob/master/devstack/lib/ironic#L1173-L117515:47
rpiosoTheJulia: There is this15:48
rpiosostack@devstack-ubuntu-server-18-04-3:~$ ls -ld /opt/stack/logs15:48
rpiosodrwxr-xr-x 3 stack stack 4096 Feb  6 21:28 /opt/stack/logs15:48
rpiosostack@devstack-ubuntu-server-18-04-3:~$ ls -l /opt/stack/logs15:48
rpiosototal 1032815:48
rpioso-rw-r--r-- 1 stack stack 10564541 Feb  7 15:47 dstat-csv.log15:48
rpiosodrwxr-xr-x 3 stack stack     4096 Feb  6 21:28 ironic-bm-logs15:48
rpiosostack@devstack-ubuntu-server-18-04-3:~$15:48
*** bnemec has quit IRC15:55
*** bnemec has joined #openstack-ironic15:56
rpiosoTheJulia: I have the logs.15:56
rpiosoTheJulia: How would you like me to share them?15:57
*** rloo has quit IRC15:57
*** rloo has joined #openstack-ironic15:57
*** TxGirlGeek has joined #openstack-ironic16:01
TheJuliarpioso: any way you feel capable of doing so16:02
*** dsneddon has joined #openstack-ironic16:06
rpiosoTheJulia: May I e-mail the zipped tarball to you?16:07
rpiosoIt's ~55 KB.16:07
TheJuliasure, just let me know which address you send it to16:09
rpiosoTheJulia: Would you like others to be cc'd?16:09
TheJuliarpioso: if you email it to juliaashleykreger@gmail.com, I can reshare the log here fairly quickly16:10
TheJuliairccloud has it as a feature16:10
rpiosoTheJulia: Is there anything else which might be helpful?16:11
TheJuliaI think we just need the agent log from the file so we can understand what actually failed and where16:11
rpiosoTheJulia: Okay, then I'll attach ironic-python-agent.log in a zipped tarball.16:14
openstackgerritMark Goddard proposed openstack/ironic master: Fix up release notes for 14.0.0  https://review.opendev.org/70656016:27
*** khansa has joined #openstack-ironic16:35
rpiosoTheJulia: I sent it to juliaashleykreger@gmail.com.16:36
*** tesseract has quit IRC16:38
openstackgerritMark Goddard proposed openstack/ironic-python-agent master: Tidy up relese notes for 6.0.0  https://review.opendev.org/70656116:41
openstackgerritMark Goddard proposed openstack/ironic master: Update API version history for v1.61  https://review.opendev.org/70656216:43
*** gyee has joined #openstack-ironic16:44
openstackgerritMark Goddard proposed openstack/ironic master: Update release mappings for Ussuri  https://review.opendev.org/70656516:47
*** lucasagomes has quit IRC16:52
*** alexmcleod has quit IRC16:56
*** tesseract has joined #openstack-ironic16:57
rpittaubye all, have a great weekend! o/17:02
*** rpittau is now known as rpittau|afk17:02
TheJuliahttps://usercontent.irccloud-cdn.com/file/DfuPt8SL/ironic-python-agent.log17:04
TheJuliaiurygregory: etingof ^^^17:04
openstackgerritMark Goddard proposed openstack/ironic-python-agent master: Tidy up relese notes for 6.0.0  https://review.opendev.org/70656117:06
etingofso `mount /dev/sda1 /tmp/tmpdyap7ltp/boot/efi` -> is not a valid block device17:08
etingofcan this be caused by corrupted filesystem?17:12
iurygregoryI have the same feeling as etingof17:17
iurygregory.-.17:17
etingofone thing I am missing... IPA seems to expose the entire /dev/sda as iscsi target to conductor. so the conductor creates partitions and writes user image into partition #2 and ESP into partition #1? is that correct?17:20
etingofeventually partition #1 will not mount. it would be interesting to mount it by hand (from inside ramdisk). may be it's a kernel timing matter...?17:21
etingofor may be conductor just mkfs.msdos partition #1, not actually writing anything there?17:23
gudrutis2Hi, I started having issues with `disk-image-builder v2.33.0`. I started getting `ERROR: Could not find a version that satisfies the requirement oslo.concurrency===4.0.0 `.17:27
*** Goneri has joined #openstack-ironic17:28
gudrutis2From what I understood it is because the job is running on python2, and oslo.concurrency===4.0.0 needs python3, but how to tell it to the script?17:28
*** dtantsur|brb is now known as dtantsur17:31
clarkbgudrutis2: if you install disk-image-builder under python3 I expect that would fix it17:31
clarkbit is possible that dib also needs to add split deps based on whether or not python2 or 3 is used17:32
dtantsurarne_wiebalck: my German... ugh :) I'm finishing the B2 book, but I don't feel ready to talk to people at all17:32
dtantsurTheJulia: sorry for the conflicts, but ... no moment will be perfect for these, and we're long overdue.17:32
dtantsurtrust me, nobody will like it in the end of the cycle either :)17:33
arne_wiebalckdtantsur: your correction was perfect :)17:33
dtantsurTheJulia: on the bright side, I think we're past the worst code move. Tear down is left, but I expect fewer conflicts in that part.17:35
dtantsurTheJulia: as my apology, feel free to throw any 3 patches at me for immediate review :)17:35
TheJuliadtantsur: yeah, It is actuall turning out not to be too horrible, just having to be careful17:35
TheJuliadtantsur: \o/17:35
gudrutis2clarkb: thanks for the tip, but that did not help. It is still running on python217:35
* arne_wiebalck will be off for a week, with only occasional network access #mid-cycle17:36
*** tesseract has quit IRC17:36
dtantsurgudrutis2: are you building IPA? try requesting stable/train branch (if using IPA-builder, there is a parameter for that)17:36
dtantsuretingof, rpittau|afk, re https://review.opendev.org/#/c/706510/: will we be ready to release sushy-cli by M2?17:38
patchbotpatch 706510 - releases - Add sushy-cli deliverable for ussuri - 1 patch set17:38
arne_wiebalckbye everyone o/17:38
*** bdodd has quit IRC17:39
*** bdodd has joined #openstack-ironic17:39
gudrutis2dtantsur: hi :) . I was pointing to cern/stein actually. I am trying to use ironic-python-agent-ramdisk  instead of ironic-agent and it has requirement that points to https://opendev.org/openstack/requirements17:40
clarkbgudrutis2: what version of python3 did you try?17:40
clarkbI think the restriction is >=3.6 so if python3 is older you may still hit it17:40
gudrutis2arne_wiebalck:o/ bye bye17:40
etingofdtantsur, the thing is already somewhat functional and it's rapidly getting better. OS project-wise it's probably alright. no docs so far.17:40
dtantsuretingof: so, we'll be fine for 0.1?17:40
etingofdtantsur, yes, I think so17:40
dtantsurthx!17:41
dtantsurTheJulia: if you do plan to use my 3-patch offer, please don't hold with it for too long, it's getting late here :)17:42
gudrutis2clarkb: yep, 3.6. But now I think it is because of the OS element (centOS) not of my build system python version17:42
TheJuliadtantsur: I'm still rebasing sadly17:42
TheJuliaand meetings :)17:42
TheJuliaMonday :)17:42
dtantsurokie, then Monday it is :)17:42
dtantsurgudrutis2: how do you set the branch?17:43
gudrutis2DIB_REPOREF_ironic_agent=$IPA_BRANCH17:43
gudrutis2ah17:43
dtantsurgudrutis2: 1. it's not correct for the new element, 2. you need the same for requirements17:43
*** k_mouza_ has quit IRC17:44
dtantsurgudrutis2: https://opendev.org/openstack/ironic-python-agent-builder/src/branch/master/ironic_python_agent_builder/__init__.py#L69-L7017:44
dtantsurmgoddard: hey, does https://review.opendev.org/#/c/706565/ assume the upcoming 14.0 release?17:44
patchbotpatch 706565 - ironic - Update release mappings for Ussuri - 1 patch set17:44
mgoddarddtantsur: yes17:45
*** khansa has quit IRC17:45
dtantsurack17:46
mgoddarddtantsur: not sure if it is required for just an intermediate release or should we wait until our ussuri GA release?17:46
dtantsurmgoddard: I think the 14.0 bit is correct, but RELEASE_MAPPING['ussuri'] may be problematic. It will change to whatever the final release will be.17:47
mgoddardok. should we keep it now and update to the final release?17:48
* dtantsur thinking17:48
dtantsurmgoddard: to be strictly correct, I think we should omit RELEASE_MAPPING['ussuri'] for now17:49
*** ociuhandu has joined #openstack-ironic17:50
*** ociuhandu has quit IRC17:56
*** priteau has quit IRC17:56
TheJuliafinally free from conference calls17:57
*** amoralej is now known as amoralej|off17:58
TheJuliadtantsur: yes, we should17:58
TheJuliawe should only tag that for the actual ussuri stable branch releases17:58
TheJuliaso wherever that branchpoint occurs from17:58
*** dougsz has quit IRC18:02
*** derekh has quit IRC18:05
*** k_mouza has joined #openstack-ironic18:14
gudrutis2dtantsur: I confirm that you were rigth. thx18:14
*** igordc has quit IRC18:18
*** k_mouza has quit IRC18:19
dtantsurgreat!18:19
etingofdtantsur, is there a story for automatic system discovery by sushy?18:20
dtantsuretingof: I don't recall seeing or creating one18:20
* etingof is not quite compatible with SB18:20
dtantsurheh, me neither18:20
etingofack18:20
dtantsuretingof: do you plan on a vendor pass-thru or a full blown new feature in ironic?18:21
etingofre sushy?18:21
dtantsuretingof: ah, you mean only in sushy?18:21
dtantsuror as a feature in ironic?18:21
etingofdtantsur, no, sushy is the first step towards taking over the world18:22
* dtantsur thinks POST /v1/drivers/sushy/discovery {'redfish_address': 'https://example.com'}18:22
dtantsuralthough here ^^^ be pretty hungry dragons18:22
* etingof thought of sushy.get_system() -> the-only-system|explosion18:23
dtantsurah, that one?18:23
etingofyes18:23
dtantsuretingof: https://storyboard.openstack.org/#!/story/200725818:23
dtantsur(you probably need a task for sushy there)18:23
etingofdtantsur is apparently SB savvy18:23
dtantsurat some point in time we should have auto-enrolling systems given redfish_{address,username,password}18:23
dtantsuretingof: I'm one of our bug triagers, I have to :)18:24
etingofthat would be another feature18:24
dtantsuretingof: and I even filed an RFE for it: https://storyboard.openstack.org/#!/story/2007273 :)18:28
openstackgerritIlya Etingof proposed openstack/sushy master: Automatically discover available system/manager/chassis  https://review.opendev.org/70660218:28
dtantsurTheJulia: see the RFE link for some API craziness ^^^18:29
TheJuliashould I be drinking?18:29
TheJuliaI need to go pickup my RV late this afternoon, I shouldn't drink before driving such a vehicle18:30
dtantsur:D18:30
dtantsurI considered drinking today, but instead I bought a lot of cakes. Better for my headache!18:30
etingofdtantsur, given most common scenario which is one system per BMC, autodiscovery feature just mentioned seems a bit of overstatement18:30
TheJuliathis conversation makes me worry we've over thought something18:31
dtantsuretingof: you're not wrong there. probably I still have some hopes that multi-node redfish happens in the end?18:31
dtantsuranyway, I'm not going to work on this RFE in the near future. just throwing it there since that's an idea that has come up previously.18:31
etingofor not? we will have to deal with shared DVD drives then18:31
TheJuliaI'm sure somewhere there is a moonshot rev 2 with an ilo418:31
dtantsurthe night is dark and full of terrors18:32
TheJuliaseriously, if anyone wants to donate a moonshot to the ironic community, I'd ensure it had power and network connectivity18:32
dtantsuralso, c'mon, we're not saying the m-word here :D18:32
* dtantsur wouldn't mind some community hardware for sure18:32
* etingof had to dispose his spark station 2018:33
TheJuliaetingof: your patch actually makes sense and was what I was kind of hoping for18:33
etingofthe fishy one?18:33
TheJuliayeah18:33
etingof\o/18:34
TheJuliaI was kind of thinking originally we would save the system info, but re-thinking it that is a bad idea18:34
etingofso I am targeting at defaulting redfish_system_id -> None18:34
etingofthat would trigger sushy to pick the only one system or fail (in a novel way)18:35
TheJuliait eems reasonable to me18:36
TheJulianow..... the autodiscovery idea, I think that is a separate thing18:36
dtantsuryep. and it does assume that multi-node redfish becomes something less exotic18:36
TheJuliaexplicitly because discovering the bmc url and system id is a next generation smbios data set.18:37
etingofit would be best to discover the BMCs on the network rather than systems within a BMC (which is trivial)18:37
etingofmay be BMCs should support UPnP...?18:38
etingofseriously, how a BMC is different from a networked boombox?18:39
TheJuliait is not like we know people who know people..... <.<18:39
TheJulia>.>18:40
dtantsuretingof: IPMI did have some discovery aspect in it. Dunno about Redfish.18:40
dtantsurheh18:40
etingofwith redfish we can use a web crawler \o/18:41
etingofe.g. scrapy18:42
dtantsurlol18:42
dtantsurwe don't know ports, so combine it with a port scanner18:42
TheJuliawell, ipmi we also had to crawl up to ?4096? different combinations to find each individual cartridge18:42
TheJuliaAeva sent me the numbers she found and they worked well on moonshots... I still miss that poor moonshot18:43
etingofodds are to find BMCs at 443/tcp18:43
dtantsurdifficult childhood, wooden toys bolted to the floor18:43
dtantsuranyway, the cake is calling, I cannot resist the call18:44
* TheJulia suggests replacing all toys with stuffed animals18:44
dtantsuralways works (and hide a real cat in between)18:44
dtantsurhave a great weekend, lovely people!18:44
TheJulia++18:44
TheJulia\o/18:44
TheJuliaHave a wonderful weekend dtantsur18:44
*** dtantsur is now known as dtantsur|afk18:45
*** igordc has joined #openstack-ironic18:49
*** k_mouza has joined #openstack-ironic18:50
*** k_mouza has quit IRC18:51
*** aedc has joined #openstack-ironic18:55
etingofif rpioso could relay my ping over to jtwill98 - that'd be appreciated. in case he needs further help18:56
openstackgerritJulia Kreger proposed openstack/ironic master: Pre-shared agent token  https://review.opendev.org/69260918:57
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Agent token support  https://review.opendev.org/69261418:58
openstackgerritJulia Kreger proposed openstack/ironic master: Enable agent_token for virtual media boot  https://review.opendev.org/69758419:10
openstackgerritJulia Kreger proposed openstack/ironic master: Send our token back to the agent  https://review.opendev.org/69758519:10
openstackgerritJulia Kreger proposed openstack/ironic master: Signal agent token is required  https://review.opendev.org/69930419:10
TheJuliadtantsur|afk: I think ^ starting with 69260919:14
*** igordc has quit IRC19:19
openstackgerritJulia Kreger proposed openstack/ironic master: Add indicators REST API endpoints  https://review.opendev.org/65178519:20
openstackgerritJulia Kreger proposed openstack/ironic master: Hash the rescue_password  https://review.opendev.org/69141319:48
*** jtomasek has quit IRC19:54
*** jtomasek has joined #openstack-ironic19:58
jlvillalTheJulia, o/ ! :)20:04
* jlvillal just got back home...20:04
*** mmethot has joined #openstack-ironic20:07
*** jdandrea has quit IRC20:07
*** mmethot_ has quit IRC20:09
*** early has quit IRC20:16
*** ociuhandu has joined #openstack-ironic20:16
*** early has joined #openstack-ironic20:20
*** ociuhandu has quit IRC20:21
*** aedc has quit IRC20:30
*** rh-jelabarre has quit IRC20:40
*** k_mouza has joined #openstack-ironic20:52
*** TxGirlGeek has quit IRC20:55
*** k_mouza has quit IRC20:56
openstackgerritMerged openstack/sushy master: Automatically discover available system/manager/chassis  https://review.opendev.org/70660221:01
*** Lucas_Gray has joined #openstack-ironic21:14
*** derekh has joined #openstack-ironic21:29
*** derekh has quit IRC21:30
openstackgerritDoug Hellmann proposed openstack/ironic master: tell reno to ignore the kilo branch  https://review.opendev.org/70662621:41
openstackgerritDoug Hellmann proposed openstack/ironic master: tell reno to ignore the kilo branch  https://review.opendev.org/70662621:42
*** ociuhandu has joined #openstack-ironic21:44
*** ociuhandu has quit IRC21:47
*** ociuhandu has joined #openstack-ironic21:47
*** ociuhandu has quit IRC22:04
*** ociuhandu has joined #openstack-ironic22:05
*** ociuhandu has quit IRC22:25
*** iurygregory has quit IRC22:29
*** rh-jelabarre has joined #openstack-ironic22:37
TheJuliaSo I think I see what the issue is with the software raid job22:39
openstackgerritJulia Kreger proposed openstack/ironic-python-agent master: Rescan after restarting the md device  https://review.opendev.org/70663222:41
TheJuliathe raid device was getting bounced to hopefully pickup changes, but they are not always being picked up, possible race somepalce in the os22:41
TheJuliaor other grumpy state, but they were present BEFORE the restart22:41
TheJuliaso hopefully that should be happy with blah22:41
TheJuliathe iscsi raid job22:42
*** jtomasek has quit IRC23:14
*** rh-jelabarre has quit IRC23:18
rpiosoetingof, TheJulia: That Redfish vmedia boot deployment failure is reproducible. Note that it's using swift, instead of http. I believe swift is the default.23:22
rpiosoetingof, TheJulia: Would it be helpful to try it with http?23:22
TheJuliarpioso: unlikely, I'll try to look at the log tonight or tomorrow23:23
rpiosoTheJulia: I figured I'd ask. Thank you. Please let me know if I can be of any further assistance.23:24
TheJuliarpioso: I suspect the log will reveal something! What, sadly I'm not sure yet :)23:25
rpiosoTheJulia: I'm confident a bit of your time and focused attention will reveal the truth.23:33
rpiosoThanks, again, for your assistance. Much appreciated!23:33
openstackgerritkhansa proposed openstack/sushy-cli master: Add system boot commands  https://review.opendev.org/70639223:40
*** rloo has quit IRC23:52
*** bobmel has joined #openstack-ironic23:54
*** bobmel has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!