)]}'
{"specs/backlog/nvmeof-storage-networking-support.rst":[{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"b23cea1f749ae85fbadba5c55406be903774e9cb","unresolved":true,"context_lines":[{"line_number":8,"context_line":"NVMe over Fabrics Storage Networking for Bare Metal"},{"line_number":9,"context_line":"\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d"},{"line_number":10,"context_line":""},{"line_number":11,"context_line":"https://bugs.launchpad.net/ironic/+bug/XXXXXXX"},{"line_number":12,"context_line":""},{"line_number":13,"context_line":"Operators want to offer bare metal nodes with dedicated storage"},{"line_number":14,"context_line":"network interfaces that connect to NVMe over Fabrics (NVMe-oF)"}],"source_content_type":"text/x-rst","patch_set":5,"id":"bec94f96_306359ca","line":11,"updated":"2026-06-12 17:53:04.000000000","message":"some limiting factors: HPE appears to require static addressing of the boot ethernet interface. Combined with the what seems to be a complete lack of authentication, and even documentation on the NVMeoF configuration options, I\u0027m tending to think it is more about OEM tooling integration and only in single tenant enterprise use cases where you build an explicit dedicated hard-zoned off storage fabric, or more likely use FC adapters.\n\nDell seems to kind of want to prefer DHCP... and has some unknown linkage/minimal docs.","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"97560503f6e47e74447623b6ee447c5c33fcab01","unresolved":true,"context_lines":[{"line_number":31,"context_line":"This specification covers two deployment scenarios, identifies"},{"line_number":32,"context_line":"gaps in Ironic\u0027s current workflow, and proposes targeted changes"},{"line_number":33,"context_line":"to support each."},{"line_number":34,"context_line":""},{"line_number":35,"context_line":".. note::"},{"line_number":36,"context_line":""},{"line_number":37,"context_line":"   This specification builds on the infrastructure defined in"}],"source_content_type":"text/x-rst","patch_set":5,"id":"f775f1a0_9dbe2452","line":34,"updated":"2026-06-12 20:16:16.000000000","message":"We would need a nova patch to handle the attach/detach actions as a pass-through to attach the interface. That increses scope. because we would need to do something similar to port plugigng.","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":24245,"name":"Harald Jensås","email":"hjensas@redhat.com","username":"harald.jensas"},"change_message_id":"62737197cf29ff9698ebc914cac93572f18e33f7","unresolved":true,"context_lines":[{"line_number":127,"context_line":"  than ``iscsi`` or ``fibre_channel``. NVMe-oF volumes cannot"},{"line_number":128,"context_line":"  be attached."},{"line_number":129,"context_line":""},{"line_number":130,"context_line":"* No mechanism exists to deliver storage connection metadata"},{"line_number":131,"context_line":"  (discovery controller IP, subsystem NQN) to the deployed"},{"line_number":132,"context_line":"  tenant OS via the configdrive."},{"line_number":133,"context_line":""},{"line_number":134,"context_line":"Scenario B: Boot from NVMe-oF Volume"},{"line_number":135,"context_line":"--------------------------------------"}],"source_content_type":"text/x-rst","patch_set":5,"id":"0ecc6421_bb65ecfc","line":132,"range":{"start_line":130,"start_character":0,"end_line":132,"end_character":32},"updated":"2026-06-12 13:11:27.000000000","message":"For a volume attache to an already deployed node there must be some other mechanism to deliver this than the configdrive.","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"b23cea1f749ae85fbadba5c55406be903774e9cb","unresolved":true,"context_lines":[{"line_number":127,"context_line":"  than ``iscsi`` or ``fibre_channel``. NVMe-oF volumes cannot"},{"line_number":128,"context_line":"  be attached."},{"line_number":129,"context_line":""},{"line_number":130,"context_line":"* No mechanism exists to deliver storage connection metadata"},{"line_number":131,"context_line":"  (discovery controller IP, subsystem NQN) to the deployed"},{"line_number":132,"context_line":"  tenant OS via the configdrive."},{"line_number":133,"context_line":""},{"line_number":134,"context_line":"Scenario B: Boot from NVMe-oF Volume"},{"line_number":135,"context_line":"--------------------------------------"}],"source_content_type":"text/x-rst","patch_set":5,"id":"ee605931_b1db36be","line":132,"range":{"start_line":130,"start_character":0,"end_line":132,"end_character":32},"in_reply_to":"0ecc6421_bb65ecfc","updated":"2026-06-12 17:53:04.000000000","message":"I\u0027d like to propose we have a model where we only boot from NVMeoF/TCP in the supported case, that gets us out of having to know/set credentials after the fact.\n\nI think the unknown is if the NBFT table can get the details into the OS (and I\u0027ve seen conflicting details here (and trying to get a discussion going with Dell specifically since they have authentication capabilities built in)).","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":24245,"name":"Harald Jensås","email":"hjensas@redhat.com","username":"harald.jensas"},"change_message_id":"62737197cf29ff9698ebc914cac93572f18e33f7","unresolved":true,"context_lines":[{"line_number":183,"context_line":""},{"line_number":184,"context_line":".. note::"},{"line_number":185,"context_line":""},{"line_number":186,"context_line":"   **Ceph and NVMe-oF**: Operators using Ceph as their"},{"line_number":187,"context_line":"   storage backend may also want NVMe-oF/TCP volume"},{"line_number":188,"context_line":"   attachment. Today, Cinder\u0027s Ceph integration uses the"},{"line_number":189,"context_line":"   CephRBD driver, which presents volumes as RBD images"}],"source_content_type":"text/x-rst","patch_set":5,"id":"0b1a7672_c6ccc736","line":186,"range":{"start_line":186,"start_character":3,"end_line":186,"end_character":24},"updated":"2026-06-12 13:11:27.000000000","message":"https://www.ibm.com/docs/en/storage-ceph/8.0.0?topic\u003dceph-nvme-gateway\nThere is already a NVMeoF gateway?","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"b23cea1f749ae85fbadba5c55406be903774e9cb","unresolved":true,"context_lines":[{"line_number":183,"context_line":""},{"line_number":184,"context_line":".. note::"},{"line_number":185,"context_line":""},{"line_number":186,"context_line":"   **Ceph and NVMe-oF**: Operators using Ceph as their"},{"line_number":187,"context_line":"   storage backend may also want NVMe-oF/TCP volume"},{"line_number":188,"context_line":"   attachment. Today, Cinder\u0027s Ceph integration uses the"},{"line_number":189,"context_line":"   CephRBD driver, which presents volumes as RBD images"}],"source_content_type":"text/x-rst","patch_set":5,"id":"2e2d7daa_8fc49baf","line":186,"range":{"start_line":186,"start_character":3,"end_line":186,"end_character":24},"in_reply_to":"0b1a7672_c6ccc736","updated":"2026-06-12 17:53:04.000000000","message":"So, in IBM Ceph. Today Cinder doesn\u0027t have a driver which presents those options.","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"526f95757f5383cc3b51151362210512dae1a5d2","unresolved":true,"context_lines":[{"line_number":1331,"context_line":""},{"line_number":1332,"context_line":"    # After: NQN auto-created during introspection"},{"line_number":1333,"context_line":"    # (no manual step required)"},{"line_number":1334,"context_line":""},{"line_number":1335,"context_line":"The operator still creates the node, ports, traits, and"},{"line_number":1336,"context_line":"deploy templates manually. Only the VolumeConnector"},{"line_number":1337,"context_line":"creation is automated."}],"source_content_type":"text/x-rst","patch_set":5,"id":"a934acee_71235005","line":1334,"updated":"2026-06-12 23:30:03.000000000","message":"NQN wise: Some workloads only support strict adherence to particular nqn formats with the 16byte uuid (see vmware nqn strictness)\n\nIdea regarding DH-HMAC-CHAP: Burn it record it on deploy, and be able to ship that as a volume connector data?","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"c587fe48a180b7a0abeacc2dac60299933a02561","unresolved":true,"context_lines":[{"line_number":1364,"context_line":"kernel\u0027s ``nvme-tcp`` driver, and can sometimes be first"},{"line_number":1365,"context_line":"asserted as a firmware setting."},{"line_number":1366,"context_line":""},{"line_number":1367,"context_line":"Credential Handling and Tenant Isolation"},{"line_number":1368,"context_line":"------------------------------------------"},{"line_number":1369,"context_line":""},{"line_number":1370,"context_line":"**DH-HMAC-CHAP is not viable today**. NVMe-oF/TCP supports"}],"source_content_type":"text/x-rst","patch_set":5,"id":"c01cae74_2c1f74b7","line":1367,"updated":"2026-06-11 18:19:03.000000000","message":"https://nvmexpress.org/wp-content/uploads/NVM-Express-Boot-Specification-Revision-1.3-2025.08.01-Ratified.pdf page 55... which I\u0027m not seeing registered in newer captures we have downstream for latest generation BMCs of major vendors.\n\nWhich is fun because I\u0027ve also started a discussion with some DMTF folks and they are pointing to example presentations and expectation setting slide decks from earlier on. The nvmexpress model *does* line up and match dmtf published model, which is a plus, but I\u0027ve not found a vendor which seems to have entirely implemented KeyService yet.\n\nWe might need to add support for Keyservice entries of nvmeof keys as well, but without actual implementations to look at I\u0027m a little hesitant. It might also explain Dell\u0027s path variable bios setting as well.","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"526f95757f5383cc3b51151362210512dae1a5d2","unresolved":true,"context_lines":[{"line_number":1367,"context_line":"Credential Handling and Tenant Isolation"},{"line_number":1368,"context_line":"------------------------------------------"},{"line_number":1369,"context_line":""},{"line_number":1370,"context_line":"**DH-HMAC-CHAP is not viable today**. NVMe-oF/TCP supports"},{"line_number":1371,"context_line":"in-band authentication (DH-HMAC-CHAP) per NVMe"},{"line_number":1372,"context_line":"specification 2.0, but delivering credentials to the bare"},{"line_number":1373,"context_line":"metal node is an unsolved problem across vendors. The NBFT"}],"source_content_type":"text/x-rst","patch_set":5,"id":"5cd7e07d_11f956f9","line":1370,"updated":"2026-06-12 23:30:03.000000000","message":"Could we generate this today and ship it up to the storage array?\n\ni.e.. could it be connector data and get regenerated on every deploy ?","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"526f95757f5383cc3b51151362210512dae1a5d2","unresolved":true,"context_lines":[{"line_number":1714,"context_line":"unavailable, and requires external orchestration. The network"},{"line_number":1715,"context_line":"attachment (dedicated storage NIC on the correct Neutron"},{"line_number":1716,"context_line":"network) is the valuable automation Ironic provides."},{"line_number":1717,"context_line":""},{"line_number":1718,"context_line":""},{"line_number":1719,"context_line":"Data model impact"},{"line_number":1720,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":5,"id":"9211937a_01c82f15","line":1717,"updated":"2026-06-12 23:30:03.000000000","message":"In a simple post-deploy path, not a boot path.\n\nA simplified network -\u003e We identify if there is a storage network\nWe then stamp and record credentials.\nWe then fire up storage -\u003e problem: we don\u0027t know the endpoint","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"526f95757f5383cc3b51151362210512dae1a5d2","unresolved":true,"context_lines":[{"line_number":2092,"context_line":"  management. Boot NIC selection for NVMe-oF appears"},{"line_number":2093,"context_line":"  more direct based on the schema, but requires"},{"line_number":2094,"context_line":"  identifying and targeting a specific NIC in the"},{"line_number":2095,"context_line":"  workflow."},{"line_number":2096,"context_line":""},{"line_number":2097,"context_line":""},{"line_number":2098,"context_line":"References"}],"source_content_type":"text/x-rst","patch_set":5,"id":"9dbd3616_902d3227","line":2095,"updated":"2026-06-12 23:30:03.000000000","message":"TODO: Research nvme subsystems as well\n\nBecause NVMe have namespace limits and the drivers need to handle things propertly to namespace scope. i.e. netapp does one thing, Ceph if ever supported do another, powerflex will do another thing most likely.  Per discussion with cardoe, he already has a bug open for this.","commit_id":"1ad28d2b100fd6900cde4560656542bfba19eec2"},{"author":{"_account_id":11655,"name":"Julia Kreger","email":"juliaashleykreger@gmail.com","username":"jkreger","status":"Flying to the moon with a Jetpack!"},"change_message_id":"acf7ca47d41aa391f58fabb5bcfcc45f1dec1ce9","unresolved":true,"context_lines":[{"line_number":22,"context_line":"   to a working solution. Readers should expect"},{"line_number":23,"context_line":"   vendor-specific nuances, open questions, and areas"},{"line_number":24,"context_line":"   where practical implementation will require hardware"},{"line_number":25,"context_line":"   validation beyond what any specification can prescribe."},{"line_number":26,"context_line":""},{"line_number":27,"context_line":"Operators want to offer bare metal nodes with dedicated storage"},{"line_number":28,"context_line":"network interfaces that connect to NVMe over Fabrics (NVMe-oF)"}],"source_content_type":"text/x-rst","patch_set":7,"id":"691a0f4b_3622e3f0","line":25,"updated":"2026-07-09 16:02:53.000000000","message":"So, we likely need to explicitly note IPv6 issues are known with nvme over tcp. Vendors are at different places overall.\n\nTimberland SIG is apparently working on trying to get this into a better place,but that won\u0027t trickle down quickly, so hardware operators might want to mentally think of this capability and gear as \"early preview\" and not even to a \"technical preview\" level of readiness with vendors. At least that is the take. I\u0027ve asked some timerbland sig folks to put something out there as where they see their work is at and where they see things being at in say 6 months, a year, 2 years just so we can begin to all reach the same page.\n\nOn top of this, I\u0027m trying to get the DMTF to do a minimal focused view for boot only, that will be in future discussions.","commit_id":"99181fe7d9d68004d96d1820db180f29f5ae04e8"}]}