flow contexts are not processing they stay in queued state for while and eventually error out Issue <!-- /*NS Branding Styles*/ --> .ns-kb-css-body-editor-container { p { font-size: 12pt; font-family: Lato; color: #000000; } span { font-size: 12pt; font-family: Lato; color: #000000; } h2 { font-size: 24pt; font-family: Lato; color: black; } h3 { font-size: 18pt; font-family: Lato; color: black; } h4 { font-size: 14pt; font-family: Lato; color: black; } a { font-size: 12pt; font-family: Lato; color: #00718F; } a:hover { font-size: 12pt; color: #024F69; } a:target { font-size: 12pt; color: #032D42; } a:visited { font-size: 12pt; color: #00718f; } ul { font-size: 12pt; font-family: Lato; } li { font-size: 12pt; font-family: Lato; } img { display: ; max-width: ; width: ; height: ; } } flow contexts are not processing they stay in queued state for a while and eventually error out Symptoms<!-- /*NS Branding Styles*/ --> .ns-kb-css-body-editor-container { p { font-size: 12pt; font-family: Lato; color: #000000; } span { font-size: 12pt; font-family: Lato; color: #000000; } h2 { font-size: 24pt; font-family: Lato; color: black; } h3 { font-size: 18pt; font-family: Lato; color: black; } h4 { font-size: 14pt; font-family: Lato; color: black; } a { font-size: 12pt; font-family: Lato; color: #00718F; } a:hover { font-size: 12pt; color: #024F69; } a:target { font-size: 12pt; color: #032D42; } a:visited { font-size: 12pt; color: #00718f; } ul { font-size: 12pt; font-family: Lato; } li { font-size: 12pt; font-family: Lato; } img { display: ; max-width: ; width: ; height: ; } } - the initial flow.fire event [sysevent] is continuously being created, about 20 retries - the flow context will error out - sys flow logs show ... (empty) Error Failed to acquire mutex and not retrying for contextId=51084ca18e107ed0854a254905eadc47 because retry count exceeded. (count=21) 29/09/2025 19:00:38 [3] (empty) Warning Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 941 seconds later, attempt 20 29/09/2025 18:44:38 (empty) Warning Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 884 seconds later, attempt 19 29/09/2025 18:29:38 (empty) Warning Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 811 seconds later, attempt 18 29/09/2025 18:15:56 (empty) Warning Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 743 seconds later, attempt 17 29/09/2025 18:03:08 (empty) Warning Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 681 seconds later, attempt 16 29/09/2025 17:51:16 (empty) Warning Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 616 seconds later, attempt 15 29/09/2025 17:40:38 [2] (empty) Warning Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 553 seconds later, attempt 14 29/09/2025 17:30:46 - on event processing, bin logs show updates to fields on table [sys_flow_context], sys_lock_owner, sys_lock_acquired, and sys_lock_touched, however flow context records have no values for such fields - Also on bin logs, the initial insert for the flow context record shows table [sys_flow_context0007], which means shard DB - node logs when flow.fire events are processed ... 2025-09-29 12:42:48 (075) worker.3 worker.3 txid=350804a18710 FlowLogger DEBUG: Flow Designer: Flow Tracing: Exited context; Current context: com.glide.telemetry.trace.AGlideTraceContext$1@760796cc; Remaining spans: {}; Remaining contexts: {} 2025-09-29 12:42:48 (075) worker.3 worker.3 txid=350804a18710 Mutex WARNING *** WARNING *** Not releasing expired mutex sys_flow_context_mutex_51084ca18e107ed0854a254905eadc47 acquired at null last touched at null 2025-09-29 12:42:48 (067) worker.3 worker.3 txid=350804a18710 FlowEventManager Queued flow.fire event in NowMQ for sys_flow_context.sys_id: 51084ca18e107ed0854a254905eadc47, sysevent.sys_id: 7d084ca187107ed0a41aa7540cbb3595, priority 5, cached: false ... 2025-09-29 12:42:48 (062) worker.3 worker.3 txid=350804a18710 GlidePFLogger WARNING *** WARNING *** Failed to get mutex for contextId=51084ca18e107ed0854a254905eadc47, scheduling retry for 55 seconds later, attempt 2 2025-09-29 12:42:48 (062) worker.3 worker.3 txid=350804a18710 Mutex Attempt to get mutex sys_flow_context_mutex_51084ca18e107ed0854a254905eadc47 with spin failed because max spins was hit 2025-09-29 12:42:48 (062) worker.3 worker.3 txid=350804a18710 Mutex Spin waiting for mutex sys_flow_context_mutex_51084ca18e107ed0854a254905eadc47 to be freed Release<!-- /*NS Branding Styles*/ --> .ns-kb-css-body-editor-container { p { font-size: 12pt; font-family: Lato; color: #000000; } span { font-size: 12pt; font-family: Lato; color: #000000; } h2 { font-size: 24pt; font-family: Lato; color: black; } h3 { font-size: 18pt; font-family: Lato; color: black; } h4 { font-size: 14pt; font-family: Lato; color: black; } a { font-size: 12pt; font-family: Lato; color: #00718F; } a:hover { font-size: 12pt; color: #024F69; } a:target { font-size: 12pt; color: #032D42; } a:visited { font-size: 12pt; color: #00718f; } ul { font-size: 12pt; font-family: Lato; } li { font-size: 12pt; font-family: Lato; } img { display: ; max-width: ; width: ; height: ; } } this issue was discovered on a yokomaha instance, however it could happen in all releases Cause<!-- /*NS Branding Styles*/ --> .ns-kb-css-body-editor-container { p { font-size: 12pt; font-family: Lato; color: #000000; } span { font-size: 12pt; font-family: Lato; color: #000000; } h2 { font-size: 24pt; font-family: Lato; color: black; } h3 { font-size: 18pt; font-family: Lato; color: black; } h4 { font-size: 14pt; font-family: Lato; color: black; } a { font-size: 12pt; font-family: Lato; color: #00718F; } a:hover { font-size: 12pt; color: #024F69; } a:target { font-size: 12pt; color: #032D42; } a:visited { font-size: 12pt; color: #00718f; } ul { font-size: 12pt; font-family: Lato; } li { font-size: 12pt; font-family: Lato; } img { display: ; max-width: ; width: ; height: ; } } - there is a custom entry in [sys_table_rotation] to shard the [sys_flow_context] table- System Definition > Table Rotations Resolution<!-- /*NS Branding Styles*/ --> .ns-kb-css-body-editor-container { p { font-size: 12pt; font-family: Lato; color: #000000; } span { font-size: 12pt; font-family: Lato; color: #000000; } h2 { font-size: 24pt; font-family: Lato; color: black; } h3 { font-size: 18pt; font-family: Lato; color: black; } h4 { font-size: 14pt; font-family: Lato; color: black; } a { font-size: 12pt; font-family: Lato; color: #00718F; } a:hover { font-size: 12pt; color: #024F69; } a:target { font-size: 12pt; color: #032D42; } a:visited { font-size: 12pt; color: #00718f; } ul { font-size: 12pt; font-family: Lato; } li { font-size: 12pt; font-family: Lato; } img { display: ; max-width: ; width: ; height: ; } } - you will need to remove the table [sys_flow_context] from table rotation [sys_table_rotation] Related Links<!-- /*NS Branding Styles*/ --> .ns-kb-css-body-editor-container { p { font-size: 12pt; font-family: Lato; color: #000000; } span { font-size: 12pt; font-family: Lato; color: #000000; } h2 { font-size: 24pt; font-family: Lato; color: black; } h3 { font-size: 18pt; font-family: Lato; color: black; } h4 { font-size: 14pt; font-family: Lato; color: black; } a { font-size: 12pt; font-family: Lato; color: #00718F; } a:hover { font-size: 12pt; color: #024F69; } a:target { font-size: 12pt; color: #032D42; } a:visited { font-size: 12pt; color: #00718f; } ul { font-size: 12pt; font-family: Lato; } li { font-size: 12pt; font-family: Lato; } img { display: ; max-width: ; width: ; height: ; } } KB1841051 - Table rotation