Skip to content

Commit issue with device in bad connection state #239

Description

@JohannesGarm

If you have a device in a bad connection state, as the uk-hex device here:

root@nsolab-02> show connections
Name                    State      Time                   Logmsg
==============================================================================================================================================================================================================================================
dk-bal-leaf-01          OPEN       2026-01-22T09:35:36
dk-bal-spine-01         OPEN       2026-01-22T09:35:36
dk-ore2-leaf-01         OPEN       2026-01-22T09:35:35
dk-ore2-leaf-02         OPEN       2026-01-22T09:35:30
dk-ore2-spine-01        CLOSED
test-01                 OPEN       2026-01-22T09:35:29
test-02                 OPEN       2026-01-22T09:35:30
test-broken-ip          CLOSED     2026-01-22T09:36:08    Timeout waiting for remote peer
uk-hex                  CLOSED     2026-01-22T09:35:08    No ED25519 host key is known for [2001:948:0:f006::13]:830 and you have requested strict checking.

The show compare command reveals that all device config appears replaced (there are over 8 thousand lines so I wont paste it here). Rollback and try to commit a service and this error occurs, causing the service to crash:

Jan 22 09:41:32 nsolab-02 clixon_server.p[926854]: pyserver[926854] evpn.py:275: EVPN service: interfaces compiled
Jan 22 09:41:33 nsolab-02 clixon_backend[926852]: xmldb_readfile: 613: UNIX error: open(/usr/local/var/controller/device-test-broken-ip-SYNCED.d/0.xml): No such file or directory
Jan 22 09:41:33 nsolab-02 clixon_backend[926852]: Jan 22 09:41:33.223865: xmldb_readfile: 613: UNIX error: open(/usr/local/var/controller/device-test-broken-ip-SYNCED.d/0.xml): No such file or directory
Jan 22 09:41:33 nsolab-02 clixon_backend[926852]: Jan 22 09:41:33.223926: from_client_msg Error in rpc_callback_call:transaction-actions-done
Jan 22 09:41:33 nsolab-02 clixon_backend[926852]: from_client_msg Error in rpc_callback_call:transaction-actions-done
Jan 22 09:41:34 nsolab-02 clixon_backend[926852]: controller_transaction_wait: 875: Yang error: Inconsistent states: (notready||wait) && other
Jan 22 09:41:34 nsolab-02 clixon_backend[926852]: Jan 22 09:41:34.893680: controller_transaction_wait: 875: Yang error: Inconsistent states: (notready||wait) && other
Jan 22 09:41:34 nsolab-02 clixon_backend[926852]: Jan 22 09:41:34.893714: clixon_backend: 926852 Terminated retval:-1
Jan 22 09:41:34 nsolab-02 clixon_backend[926852]: clixon_backend: 926852 Terminated retval:-1
Jan 22 09:41:42 nsolab-02 clixon_server.p[926854]: pyserver[926854] client.py:321: Socket closed, backend probably died

sometimes the path /usr/local/var/controller/device-test-broken-ip-SYNCED.d/0.xml is uk-hex's instead but they are both missing and the result is the same.

Interestingly, clixon does not crash if it is only the test-broken-ip device that is enabled.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions