)]}'
{"/PATCHSET_LEVEL":[{"author":{"_account_id":30491,"name":"Radosław Piliszek","display_name":"Radek","email":"radek@piliszek.it","username":"yoctozepto","status":"self-employed techologist, collaborating mostly with 7bulls.com"},"change_message_id":"721369cb9724fedeefd181c3bd3bc7e510294026","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"031ef8ce_eaa67144","updated":"2022-05-27 18:21:43.000000000","message":"Done: https://review.opendev.org/c/openstack/kolla-ansible/+/843671","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":30491,"name":"Radosław Piliszek","display_name":"Radek","email":"radek@piliszek.it","username":"yoctozepto","status":"self-employed techologist, collaborating mostly with 7bulls.com"},"change_message_id":"732ad1901a2ee6306c35c5c00401f14b4bb56539","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"8140a6b5_686faac1","updated":"2022-05-27 17:50:49.000000000","message":"Forwardport-Candidate","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":13252,"name":"Dr. Jens Harbott","display_name":"Jens Harbott (frickler)","email":"frickler@offenerstapel.de","username":"jrosenboom"},"change_message_id":"00c305e9bf2e9c18f341fd6d6191453038cfc8cd","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"c489ade3_bfb4fd26","updated":"2022-05-27 08:36:15.000000000","message":"I don\u0027t know the history of the retry count, but I agree that a job that may need 5 retries should be experimental at best, in particular if each attempt may take 2 hours.\nShould backport is potentially \u003d\u003d should also forward port.","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":30491,"name":"Radosław Piliszek","display_name":"Radek","email":"radek@piliszek.it","username":"yoctozepto","status":"self-employed techologist, collaborating mostly with 7bulls.com"},"change_message_id":"d94aa3a7989fc42c9420827c98498ef80f246ff7","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"24606a20_00e96741","updated":"2022-05-27 18:30:27.000000000","message":"I\u0027m getting this into Ussuri.","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":30491,"name":"Radosław Piliszek","display_name":"Radek","email":"radek@piliszek.it","username":"yoctozepto","status":"self-employed techologist, collaborating mostly with 7bulls.com"},"change_message_id":"0187f6db138575435af1b5b3a85bd9ab1a645832","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"1b5919da_373b5c28","updated":"2022-05-27 17:55:12.000000000","message":"check experimental","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":4146,"name":"Clark Boylan","email":"cboylan@sapwetik.org","username":"cboylan"},"change_message_id":"893759c1ba4fae6f4940fbd94252246fe7833db0","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"e4ebc557_7a146e7b","in_reply_to":"730793b5_ac0900c4","updated":"2022-05-27 15:34:24.000000000","message":"It applies to the pre playbook and it applies to the whole job if ansible determines that the failure was due to network connectivity issues. In this case the job appears to be taking about an hour to fill up its disk then fail due to \"network conenctivity issues\" because ansible can\u0027t write its remote scripts to tmp dirs:\n\n  TASK [remove-build-sshkey : Remove the build SSH key from all nodes]\n  primary | MODULE FAILURE:\n  primary | Traceback (most recent call last):\n  primary |   File \"\u003cstdin\u003e\", line 102, in \u003cmodule\u003e\n  primary |   File \"\u003cstdin\u003e\", line 87, in _ansiballz_main\n  primary |   File \"/usr/lib64/python3.6/tempfile.py\", line 360, in mkdtemp\n  primary |     prefix, suffix, dir, output_type \u003d _sanitize_params(prefix, suffix, dir)\n  primary |   File \"/usr/lib64/python3.6/tempfile.py\", line 130, in _sanitize_params\n  primary |     dir \u003d gettempdir()\n  primary |   File \"/usr/lib64/python3.6/tempfile.py\", line 298, in gettempdir\n  primary |     tempdir \u003d _get_default_tempdir()\n  primary |   File \"/usr/lib64/python3.6/tempfile.py\", line 233, in _get_default_tempdir\n  primary |     dirlist)\n  primary | FileNotFoundError: [Errno 2] No usable temporary directory found in [\u0027/tmp\u0027, \u0027/var/tmp\u0027, \u0027/usr/tmp\u0027, \u0027/home/zuul\u0027]\n  primary | ERROR: Ignoring Errors\n\nMy concern is that you\u0027re setting it globally for all of your jobs and it is problemtic on jobs like this. Instead of setting it globally you should set it in a targetted fashion while addressing problems rather than simply accepting 5 retries is ok. For example in this case I imagine that filling the disk is fairly determinstic and you\u0027re hitting the luck of the draw on which cloud (and consequently node flavor) you end up with. The solution here is not to retry 5 times blindly it is to fix the job.","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":30491,"name":"Radosław Piliszek","display_name":"Radek","email":"radek@piliszek.it","username":"yoctozepto","status":"self-employed techologist, collaborating mostly with 7bulls.com"},"change_message_id":"2a1a2e6696121d3741fb02526217bb0fd9316b0a","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"1f66da78_f03983ea","in_reply_to":"8140a6b5_686faac1","updated":"2022-05-27 17:55:34.000000000","message":"Limited to retries though.","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":30491,"name":"Radosław Piliszek","display_name":"Radek","email":"radek@piliszek.it","username":"yoctozepto","status":"self-employed techologist, collaborating mostly with 7bulls.com"},"change_message_id":"77ea175f4ec3606c65a0725fb2fedf9651aa4936","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"730793b5_ac0900c4","in_reply_to":"c489ade3_bfb4fd26","updated":"2022-05-27 08:41:42.000000000","message":"Hmm, at some point we were told that retries apply only to the pre playbook which sets up the stage. In that case, the 5 retries are reasonable. If it applies to the entire job, then it does not make sense at all. Please clarify.","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"},{"author":{"_account_id":30491,"name":"Radosław Piliszek","display_name":"Radek","email":"radek@piliszek.it","username":"yoctozepto","status":"self-employed techologist, collaborating mostly with 7bulls.com"},"change_message_id":"732ad1901a2ee6306c35c5c00401f14b4bb56539","unresolved":false,"context_lines":[],"source_content_type":"","patch_set":1,"id":"a99fb397_b9944985","in_reply_to":"e4ebc557_7a146e7b","updated":"2022-05-27 17:50:49.000000000","message":"Thanks for the explanations. We are hunting issues so I agree this is a much better approach.","commit_id":"99410ae6e434cf1172b3f621cec24e67493239b7"}]}