Resource exhausted not seen during Plan

[rbastiaans-tc]

Description

Run Levant plan with a job requesting too much resources:

• Levant Plan will succeed successfully:

2022-11-09T15:46:38Z |DEBU| levant/plan: triggering Nomad plan
2022-11-09T15:46:38Z |INFO| levant/plan: group xxxx and task xxxx plan indicates change of Resources:MemoryMB from 4096 to 8192

Run Nomad plan with a job requesting too much resources:

• Nomad Plan will fail:

Scheduler dry-run:
- WARNING: Failed to place all allocations.
  Task Group "xxxx" (failed to place 1 allocation):
    * Resources exhausted on 3 nodes
    * Dimension "memory" exhausted on 3 nodes

Output of levant version:

$ levant -version
Levant v0.3.1

Output of nomad version:

$ nomad -version
Nomad v1.3.1 (2b054e38e91af964d1235faa98c286ca3f527e56)

I think this is related to this was only solved for deploy and not for plan:

• Evaluations can incur errors which Levant does not catch #39