)]}'
{"/PATCHSET_LEVEL":[{"author":{"_account_id":9708,"name":"Balazs Gibizer","display_name":"gibi","email":"gibizer@gmail.com","username":"gibi"},"change_message_id":"1f4fd03c1caaf85185fdbd813facc342ed9c3a75","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"527bcc79_45edbee7","updated":"2024-09-04 11:04:58.000000000","message":"I looked at the ceph job failures:\n\nComputes are not mapped.\n```\nDetails: Fault: {\u0027code\u0027: 400, \u0027created\u0027: \u00272024-09-03T17:58:13Z\u0027, \u0027message\u0027: \"Host \u0027compute-0.ctlplane.example.com\u0027 is not mapped to any cell\"}. Request ID of server operation performed before checking the server status req-c677e57b-825c-4ca3-940c-e63dcf85f72d.\n```\n\nThe compute-1 and -2 logs shows libvirt error:\n```\nSep 03 17:51:57 compute-2 nova_compute[167667]: libvirt:  error : internal error: could not initialize domain event timer\n1010\tSep 03 17:51:57 compute-2 nova_compute[167667]: 2024-09-03 17:51:57.325 2 WARNING nova.virt.libvirt.host [None req-05930219-6572-43f3-ac7a-bcd33dbc12a4 - - - - - -] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer\n```\n\nbut the compute starts up properly afterwards.\n\nThe host mapping run at:\n\n```\n2024-09-03 13:51:59.932104 | controller | TASK [edpm_deploy : Run nova-manage discover_hosts to ensure compute nodes are mapped _raw_params\u003doc rsh --namespace\u003d{{ cifmw_install_yamls_defaults[\u0027NAMESPACE\u0027] }} nova-cell0-conductor-0 nova-manage cell_v2 discover_hosts --verbose] ***\n2024-09-03 13:51:59.932122 | controller | Tuesday 03 September 2024  13:51:57 -0400 (0:17:40.219)       0:50:03.532 *****\n2024-09-03 13:51:59.932146 | controller | changed: [localhost]\n```\n\n\nThe compute-0 reported first time a second later:\n```\nSep 03 17:52:00 compute-0 nova_compute[192628]: 2024-09-03 17:52:00.818 2 WARNING nova.compute.manager [None req-706ddbac-111f-411f-a3da-6af46d692a5d - - - - - -] No compute node record found for host compute-0.ctlplane.example.com. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host compute-0.ctlplane.example.com could not be found.\n```\n\nSo this just the known CI race due to slow compute startup.","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"28ff3590b794413496a92b544203635d7f1db366","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"0b2190ee_396ad207","updated":"2024-09-02 23:07:34.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"55de5c2913d0616f1f0a365c1e5c6994992380d5","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"4cd16919_9b1e822d","updated":"2024-09-03 11:43:11.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"0688dd325177071a1b539bc201b76bc3fc8595bc","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"5520118a_7bd36227","updated":"2024-09-03 00:05:58.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"cb18a12e6190192a2725396ba2614ce658e193a3","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"554cfb33_f92b6614","updated":"2024-09-02 23:03:23.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"942d2b7dbe50723d3940173cb03483209f13aabc","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"9e1cd4a1_662e1fe4","updated":"2024-09-02 23:33:01.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"e78eac636eeb1451f90dcb52313486df3b9fcc53","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"9ef18657_8409a5b9","updated":"2024-09-02 22:54:56.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"5a1a71891154156bbf9612dbd7a67f0f2fb90696","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"c6159980_2a3676a0","updated":"2024-09-02 23:26:15.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"24c2929d115048a5cbf77448517a6d8c32da2025","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"fb5b115a_6100e1c6","updated":"2024-09-02 23:15:09.000000000","message":"check rdo experimental","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"37cc3182210aa3377c31a736137d4ccfa89ed2f3","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"ced0e3ab_b23bc99d","updated":"2024-09-03 18:59:31.000000000","message":"fun one test \"test_verify_created_server_ephemeral_disk\" failed in the local storage job\n\nhttps://logserver.rdoproject.org/62/927762/1/openstack-experimental/nova-operator-tempest-multinode/8953b3f/controller/ci-framework-data/tests/test_operator/tempest-tests/stestr_results.html\n\netails: Fault: {\u0027code\u0027: 500, \u0027created\u0027: \u00272024-09-03T17:34:38Z\u0027, \u0027message\u0027: \u0027Build of instance 263ccd01-10b1-46a6-9f81-a6fc27c7177a aborted: Disk info file is invalid: Base image failed safety check\u0027}. Request ID of server operation performed before checking the server status req-fcf3a278-3417-4a6d-8b10-66e91ca1677d.\n\nthis is proably a ci job config issue.\n\ni looks like it uses CONF.scenario.img_file intenrally based on this check\n\nhttps://github.com/openstack/tempest/blob/f6bb9d1e4b30ac11132023d11c36f1fb48b2934a/tempest/api/compute/admin/test_create_server.py#L45C36-L45C59\n\nand i dont think we are properly configurign that.\n\nhttps://paste.opendev.org/show/bhg1U6yKf1xApu8NMp4R/\n\nSafety check mbr on gpt failed because GPT MBR has no partitions defined: oslo_utils.imageutils.format_inspector.SafetyViolation: GPT MBR has no partitions defined\nSep 03 17:34:28 compute-2 nova_compute[133243]: 2024-09-03 17:34:28.366 2 WARNING nova.virt.libvirt.imagebackend [None req-fcf3a278-3417-4a6d-8b10-66e91ca1677d 60ed4d3e522640b6ad19633b28c5b5bb ae43aec9c3c242a785c8256abdda1747 - - default default] Base image /var/lib/nova/instances/_base/ephemeral_1_0706d66 failed safety check: Safety checks failed: mbr: oslo_utils.imageutils.format_inspector.SafetyCheckFailed: Safety checks failed: mbr\n\nfun..\n\nso i i undersnad that properly \nthe backing file for the ephmeral disk does not have an mbr does not have an mbr\n\nso this might actully be an upstream bug.\n\nthe full nova comptue log is here\n\nhttps://logserver.rdoproject.org/62/927762/1/openstack-experimental/nova-operator-tempest-multinode/8953b3f/controller/ci-framework-data/logs/38.102.83.210/service_logs/edpm_nova_compute.service.log","commit_id":"ec82b55ce9f2b5d819cb1d447f8ee0ab10f7e4b2"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"64b6ea32ffcc4bee36bdec734a475ff835944e8e","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":2,"id":"28dded49_1f6a50f3","updated":"2025-03-28 15:21:36.000000000","message":"check rdo experimental","commit_id":"8e4b53bbb90925c28f0ce2ed29d118316bd8750a"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"816d36c99a96588b1ad418b7b206383bd3e3c770","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":2,"id":"97921085_5ef5735b","updated":"2024-10-03 18:00:33.000000000","message":"check rdo experimental","commit_id":"8e4b53bbb90925c28f0ce2ed29d118316bd8750a"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"56863f7c0ac47db1c053ee58824639f641c57137","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":2,"id":"b234fc3b_cb3bdd51","updated":"2024-09-11 19:03:44.000000000","message":"check rdo experimental","commit_id":"8e4b53bbb90925c28f0ce2ed29d118316bd8750a"},{"author":{"_account_id":9708,"name":"Balazs Gibizer","display_name":"gibi","email":"gibizer@gmail.com","username":"gibi"},"change_message_id":"82cb3499c75dc25ff17ae6c7619f3bd06cf3584d","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":3,"id":"fba93e95_2555e44c","updated":"2025-06-12 14:47:19.000000000","message":"check rdo experimental","commit_id":"f5492996a3a724ea1d78c30d619483a6f49bd3ad"}]}