)]}'
{"/PATCHSET_LEVEL":[{"author":{"_account_id":27615,"name":"Rajat Dhasmana","email":"rajatdhasmana@gmail.com","username":"whoami-rajat"},"change_message_id":"a0afdd546874fe135dcce7f8f77ccd0e58f9ef3a","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":6,"id":"589e7451_6bcd2cd2","updated":"2025-12-04 17:43:18.000000000","message":"Thanks Luigi for the review.","commit_id":"d23874627a144c23382677e831a55e53f7992226"},{"author":{"_account_id":9236,"name":"Jon Bernard","email":"jobernar@redhat.com","username":"jbernard"},"change_message_id":"effe9c732d79a760523f4d855be846324542966e","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":7,"id":"fbec006c_bf73a444","updated":"2026-06-03 18:10:55.000000000","message":"Logic looks okay to me.","commit_id":"c5a7886867ab81078bb3aff7eb044bcb47b604ca"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"c73c659e2d345931bce4fee01f1418bb77619835","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":7,"id":"70fd6a89_91464a51","updated":"2026-06-03 19:24:08.000000000","message":"i would prefer if we enabeld this in one fo the exiting jobs before we merged this.\n\nhttps://review.opendev.org/c/openstack/devstack-plugin-ceph/+/952107 is currently runnig so ltest wait for ti to reprot back\n\nwe can then use that to validate it going forward.","commit_id":"c5a7886867ab81078bb3aff7eb044bcb47b604ca"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"870ad495b60f2cb605b52532dd70ff85836b3688","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":7,"id":"b401754b_21270eb2","updated":"2026-06-04 20:41:02.000000000","message":"looking at the result this did dpeloy correctly\n\nhttps://zuul.opendev.org/t/openstack/build/a5d0bab3b1844aecadf58a84ca73ad20/log/controller/logs/services.txt\n\nwe can see there are 2 osd dpeloy adn runing\n\nthere are a couple fo test failures\n\nhttps://6aa6d8639a2c250fc6cf-ff1e6572e024e404a82f69f5d976dc9d.ssl.cf2.rackcdn.com/openstack/a5d0bab3b1844aecadf58a84ca73ad20/testr_results.html\n\nthe 4 encuypte and retype failures dont look like they are related although i did notcie that there are some os-birck permission issues\n\n```\n rados.PermissionDeniedError: [errno 13] RADOS permission denied (error connecting to the cluster)\n````\n \n that may be relate din teh volume logs \n \n as well as \n```\nNot using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError\n```\n\nso that might have impacted the boot form cloned encypted volume tests./\n\nbut the main issue is \n\n````\nun 04 19:57:31.081300 npbc0a10fe21734 cinder-volume[119779]: DEBUG os_brick.initiator.connector [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] Factory for rbd on None {{(pid\u003d119779) factory /opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/connector.py:243}}\nJun 04 19:57:31.081300 npbc0a10fe21734 cinder-volume[119779]: DEBUG os_brick.initiator.connectors.rbd [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] \u003d\u003d\u003e connect_volume: call \"{\u0027self\u0027: \u003cos_brick.initiator.connectors.rbd.RBDConnector object at 0x7f6cd788ec10\u003e, \u0027connection_properties\u0027: {\u0027name\u0027: \u0027volumes/volume-9ad5d780-b699-420b-9158-d36ac96cd438\u0027, \u0027hosts\u0027: [\u0027127.0.0.1\u0027], \u0027ports\u0027: [\u00276789\u0027], \u0027cluster_name\u0027: \u0027ceph\u0027, \u0027auth_enabled\u0027: True, \u0027auth_username\u0027: \u0027cinder2\u0027, \u0027secret_type\u0027: \u0027ceph\u0027, \u0027secret_uuid\u0027: \u0027***\u0027, \u0027volume_id\u0027: \u00279ad5d780-b699-420b-9158-d36ac96cd438\u0027, \u0027discard\u0027: True, \u0027qos_specs\u0027: None, \u0027access_mode\u0027: \u0027rw\u0027, \u0027encrypted\u0027: False, \u0027cacheable\u0027: False, \u0027: False}}\" {{(pid\u003d119779) trace_logging_wrapper /opt/stack/data/venv/lib/python3.13/site-packages/os_brick/utils.py:175}}\nJun 04 19:57:31.083046 npbc0a10fe21734 cinder-volume[119779]: DEBUG os_brick.initiator.linuxrbd [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] opening connection to ceph cluster {{(pid\u003d119779) connect /opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/linuxrbd.py:72}}\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] Error connecting to ceph cluster.: rados.PermissionDeniedError: [errno 13] RADOS permission denied (error connecting to the cluster)\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd Traceback (most recent call last):\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/linuxrbd.py\", line 78, in connect\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd     client.connect()\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd     ~~~~~~~~~~~~~~^^\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd   File \"rados.pyx\", line 690, in rados.Rados.connect\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd rados.PermissionDeniedError: [errno 13] RADOS permission denied (error connecting to the cluster)\nJun 04 19:57:31.101723 npbc0a10fe21734 cinder-volume[119779]: ERROR os_brick.initiator.linuxrbd \nJun 04 19:57:31.108468 npbc0a10fe21734 cinder-volume[119779]: DEBUG os_brick.initiator.connectors.rbd [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] \u003c\u003d\u003d connect_volume: exception (27ms) BrickException(\u0027Error connecting to ceph cluster.\u0027) {{(pid\u003d119779) trace_logging_wrapper /opt/stack/data/venv/lib/python3.13/site-packages/os_brick/utils.py:188}}\nJun 04 19:57:31.109850 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] Failed to attach volume encryptor 9ad5d780-b699-420b-9158-d36ac96cd438.: os_brick.exception.BrickException: Error connecting to ceph cluster.\nJun 04 19:57:31.125593 npbc0a10fe21734 cinder-volume[119872]: INFO cinder.volume.manager [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] Terminate volume connection completed successfully.\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager [None req-1cad7686-eb96-4b06-b33a-22961b2f959e tempest-VolumeRetypeWithMigrationTest-330999003 None] Failed to copy volume 1764ffc1-234e-40c5-9ae0-c9cf69948d85 to 9ad5d780-b699-420b-9158-d36ac96cd438: os_brick.exception.BrickException: Error connecting to ceph cluster.\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager Traceback (most recent call last):\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/linuxrbd.py\", line 78, in connect\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     client.connect()\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     ~~~~~~~~~~~~~~^^\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"rados.pyx\", line 690, in rados.Rados.connect\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager rados.PermissionDeniedError: [errno 13] RADOS permission denied (error connecting to the cluster)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager \nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager \nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager Traceback (most recent call last):\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/cinder/cinder/volume/manager.py\", line 2440, in _migrate_volume_generic\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     self._copy_volume_data(ctxt, volume, new_volume, remote\u003d\u0027dest\u0027)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/cinder/cinder/volume/manager.py\", line 2312, in _copy_volume_data\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     dest_attach_info \u003d self._attach_volume(\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager         ctxt, dest_vol, properties,\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager         remote\u003ddest_remote,\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager         attach_encryptor\u003dattach_encryptor)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/cinder/cinder/volume/manager.py\", line 2253, in _attach_volume\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     with excutils.save_and_reraise_exception():\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/oslo_utils/excutils.py\", line 266, in __exit__\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     self.force_reraise()\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     ~~~~~~~~~~~~~~~~~~^^\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/oslo_utils/excutils.py\", line 232, in force_reraise\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     raise self.value\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/cinder/cinder/volume/manager.py\", line 2242, in _attach_volume\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     attach_info \u003d self._connect_device(conn)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/cinder/cinder/volume/manager.py\", line 2199, in _connect_device\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     vol_handle \u003d connector.connect_volume(conn[\u0027data\u0027])\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/utils.py\", line 185, in trace_logging_wrapper\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     result \u003d f(*args, **kwargs)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/utils.py\", line 327, in change_encrypted\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     res \u003d func(self, connection_properties)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/connectors/rbd.py\", line 270, in connect_volume\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     rbd_handle \u003d self._get_rbd_handle(connection_properties)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/connectors/rbd.py\", line 142, in _get_rbd_handle\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     rbd_client \u003d linuxrbd.RBDClient(user, pool, conffile\u003dconf,\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager                                     rbd_cluster_name\u003dstr(cluster_name))\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/linuxrbd.py\", line 63, in __init__\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     self.client, self.ioctx \u003d self.connect()\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager                               ~~~~~~~~~~~~^^\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager   File \"/opt/stack/data/venv/lib/python3.13/site-packages/os_brick/initiator/linuxrbd.py\", line 86, in connect\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager     raise exception.BrickException(message\u003dmsg)\nJun 04 19:57:31.620298 npbc0a10fe21734 cinder-volume[119779]: ERROR cinder.volume.manager os_brick.exception.BrickException: Error connecting to ceph cluster.\n```\n\nwhich i dont think is an issue in this patch so i think we can proceed and you can continue to build on this in the test patch","commit_id":"c5a7886867ab81078bb3aff7eb044bcb47b604ca"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"bde72845842da4156e868fabaa2900e9d0a18e4c","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":7,"id":"8fd705bc_b2d4b443","updated":"2026-06-04 19:19:27.000000000","message":"reviewign the logs form \nhttps://review.opendev.org/c/openstack/cinder-tempest-plugin/+/952882\nthis appres to be corect\n\nhttps://zuul.openstack.org/stream/a5d0bab3b1844aecadf58a84ca73ad20?logfile\u003dconsole.log\n\nis still in flight but its already passign tempst so i will +w once it reports back","commit_id":"c5a7886867ab81078bb3aff7eb044bcb47b604ca"},{"author":{"_account_id":4523,"name":"Eric Harney","email":"eharney@redhat.com","username":"eharney"},"change_message_id":"983439cfde46802270706b379d83c13e088ea1a7","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":7,"id":"5949641e_ad376cba","updated":"2026-06-04 21:06:54.000000000","message":"set-require-min-compat-client is not called on both clusters, which is not great -- will need to fix that","commit_id":"c5a7886867ab81078bb3aff7eb044bcb47b604ca"}],"devstack/lib/cephadm":[{"author":{"_account_id":10459,"name":"Luigi Toscano","email":"ltoscano@redhat.com","username":"ltoscano"},"change_message_id":"53398e7530e4af7caa03d872a14198070051c0dd","unresolved":true,"context_lines":[{"line_number":241,"context_line":"        test -e $CEPH_KEYRING"},{"line_number":242,"context_line":"    fi"},{"line_number":243,"context_line":""},{"line_number":244,"context_line":"    if [[ \"$MULTI_CEPH\" \u003d\u003d \u0027True\u0027 ]]; then"},{"line_number":245,"context_line":"        $SUDO \"$CEPHADM\" --image \"$CONTAINER_IMAGE\" \\"},{"line_number":246,"context_line":"            bootstrap \\"},{"line_number":247,"context_line":"            --fsid $CEPH2_FSID \\"}],"source_content_type":"application/x-shellscript","patch_set":6,"id":"94eca2e3_9cb200f3","line":244,"updated":"2025-10-28 15:46:48.000000000","message":"more than MULTI_CEPH, shouldn\u0027t this be called \"ADDITIONAL_CEPH\"?\n\nIdeally the whole configuration would done through a variable with an integert value which would configure the requested amount of ceph pools.","commit_id":"d23874627a144c23382677e831a55e53f7992226"},{"author":{"_account_id":27615,"name":"Rajat Dhasmana","email":"rajatdhasmana@gmail.com","username":"whoami-rajat"},"change_message_id":"a0afdd546874fe135dcce7f8f77ccd0e58f9ef3a","unresolved":true,"context_lines":[{"line_number":241,"context_line":"        test -e $CEPH_KEYRING"},{"line_number":242,"context_line":"    fi"},{"line_number":243,"context_line":""},{"line_number":244,"context_line":"    if [[ \"$MULTI_CEPH\" \u003d\u003d \u0027True\u0027 ]]; then"},{"line_number":245,"context_line":"        $SUDO \"$CEPHADM\" --image \"$CONTAINER_IMAGE\" \\"},{"line_number":246,"context_line":"            bootstrap \\"},{"line_number":247,"context_line":"            --fsid $CEPH2_FSID \\"}],"source_content_type":"application/x-shellscript","patch_set":6,"id":"3ffb741b_d83b8552","line":244,"in_reply_to":"94eca2e3_9cb200f3","updated":"2025-12-04 17:43:18.000000000","message":"I agree that this should be more scale-able but with the limited knowledge and time around devstack tooling, the current setup served my purpose which was to create a base infra for replication testing (without affecting the default 1 ceph deployment setup). I would be happy to review such an effort if someone picks it up but unfortunately I won\u0027t be able to pursue it.\nAlso the change for ADDITIONAL_CEPH is good but will require refactor of this and patches dependent on it so i will keep that as a note if needed to propose a revision.","commit_id":"d23874627a144c23382677e831a55e53f7992226"},{"author":{"_account_id":11604,"name":"sean mooney","email":"smooney@redhat.com","username":"sean-k-mooney"},"change_message_id":"bde72845842da4156e868fabaa2900e9d0a18e4c","unresolved":true,"context_lines":[{"line_number":29,"context_line":"BOOTSTRAP_CONFIG\u003d\"$HOME/bootstrap_ceph.conf\""},{"line_number":30,"context_line":"CEPH_KEYRING\u003d\"/etc/ceph/ceph.client.admin.keyring\""},{"line_number":31,"context_line":"CEPH2_KEYRING\u003d\"/etc/ceph2/ceph.client.admin.keyring\""},{"line_number":32,"context_line":"CEPH2_IP\u003d\"127.0.0.1\""},{"line_number":33,"context_line":"CEPH2_FSID\u003d$(uuidgen)"},{"line_number":34,"context_line":"TARGET_BIN\u003d/usr/bin"},{"line_number":35,"context_line":"# TOGGLED IN THE CI TO SAVE RESOURCES"}],"source_content_type":"application/x-shellscript","patch_set":7,"id":"132b7bb2_1d6034f3","line":32,"range":{"start_line":32,"start_character":1,"end_line":32,"end_character":20},"updated":"2026-06-04 19:19:27.000000000","message":"i guess for this usecause this is ok as you intenatlly are only intendign to suprot singel node.","commit_id":"c5a7886867ab81078bb3aff7eb044bcb47b604ca"}]}