Skip to content

Releases: microsoft/BC-Bench

v0.5.3

01 May 13:26
60e0e35

Choose a tag to compare

Improved documentation on how to run experiments.

Removed mini-bc-agent, focus on GitHub Copilot and Claude Code.

Stopped pinning BcContainerHelper, always use the latest version, and fixed the v24 tasks in the pipeline.

Bump GitHub Copilot version to 1.0.39 to include gpt-5.5

Introduce an automated candidate screening pipeline for potential dataset refresh.

Enforce additional ruff rules.

Versions

  • GitHub Copilot CLI 1.0.39
  • Claude Code 2.1.116
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.33.55542

v0.5.2

24 Apr 13:12
f13a647

Choose a tag to compare

Refactored tool usage from parsing log files to using PreToolUse hooks.

Bump Claude Code version referencing https://www.anthropic.com/engineering/april-23-postmortem

Pining BCContainerHelper and uv for pipeline instabilities.

Versions

  • GitHub Copilot CLI 1.0.31
  • Claude Code 2.1.116
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.33.55542
  • BcContainerHelper 6.1.12

v0.5.1

20 Apr 06:50
ad2e7c3

Choose a tag to compare

Update agent harnesses to include claude-opus-4.7, also refresh the list of supported models.

Versions

  • GitHub Copilot CLI 1.0.31
  • Claude Code 2.1.112
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.33.55542

v0.5.0

13 Apr 07:59
569c3fd

Choose a tag to compare

Major refactor of the Python codebase for extensibility across categories.

Versions

  • GitHub Copilot CLI 1.0.2
  • Claude Code 2.1.69
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.33.55542

v0.4.0

19 Mar 16:08

Choose a tag to compare

Fixed the AL MCP compile tool integration in BC-Bench #592

Improved and adjusted the options and settings for Claude Code and GitHub Copilot.

Repository setup now sparse-checks out only app folders, improving clone performance.

Fixed two PNG file conversions for a dataset entry.

Timeout is extended from 90 mins to 120 mins, due to the compile tool from al mcp

Versions

  • GitHub Copilot CLI 1.0.2
  • Claude Code 2.1.69
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.33.55542

v0.3.2

14 Mar 16:08
19f541d

Choose a tag to compare

Update al mcp to latest version.

Versions

  • GitHub Copilot CLI 1.0.2
  • Claude Code 2.1.47
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.33.55542

v0.3.1

11 Mar 11:59
94e4eeb

Choose a tag to compare

Update Copilot and refresh the list of supported models.

Versions

  • GitHub Copilot CLI 1.0.2
  • Claude Code 2.1.47
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.30.49729-beta

v0.3.0

27 Feb 12:00

Choose a tag to compare

Updated Test-Generation category's prompt to be more explicitly that the agent is expected to create a new test case.

Versions

  • GitHub Copilot CLI 0.0.411
  • Claude Code 2.1.47
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.30.49729-beta

v0.2.2

18 Feb 23:47
ad87fff

Choose a tag to compare

Bumping version for both Claude Code and GitHub Copilot to include claude-sonnet-4.6

Versions

  • GitHub Copilot CLI 0.0.411
  • Claude Code 2.1.47
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.30.49729-beta

v0.2.1

18 Feb 22:13
085990e

Choose a tag to compare

Bumping GitHub Copilot CLI version to include gpt-5.3-codex, minor version bump given the small version increase

Versions

  • GitHub Copilot CLI 0.0.409
  • Claude Code 2.1.37
  • Microsoft.Dynamics.BusinessCentral.Development.Tools 17.0.30.49729-beta