Skip to content

Add 13 advanced CAD modeling tasks (A5–A6 tier)#176

Merged
ecto merged 1 commit intomainfrom
claude/audit-mecheval-launch-0PS1d
May 5, 2026
Merged

Add 13 advanced CAD modeling tasks (A5–A6 tier)#176
ecto merged 1 commit intomainfrom
claude/audit-mecheval-launch-0PS1d

Conversation

@ecto
Copy link
Copy Markdown
Owner

@ecto ecto commented May 5, 2026

Summary

This PR adds 13 new advanced CAD modeling tasks to the mecheval benchmark suite, spanning tiers A5 and A6. These tasks cover a range of mechanical engineering features including flanged discs, lightened components, stepped bosses, compound assemblies, and specialized parts like pulleys and sprockets.

Tasks Added

Tier A5 (7 tasks):

  • a5-disc-hub-01: Flanged disc with raised central hub, central bore, and 6-bolt circle
  • a5-lightened-disc-01: Disc with central bore and six lightening holes
  • a5-stepped-boss-plate-01: Rectangular plate with raised central boss and through features
  • a5-ribbed-plate-01: Plate with three longitudinal stiffening ribs and corner bolts
  • a5-u-bracket-01: U-channel bracket with mounting holes
  • a5-double-d-shaft-01: Cylindrical shaft with two opposing flats (double-D profile)
  • a5-hex-bolt-blank-01: Hex-head bolt blank (head + shank, no thread)
  • a5-hollow-cap-01: Hollow cylindrical cap with 8mm base wall

Tier A6 (5 tasks):

  • a6-compound-boss-01: Rectangular base with two raised cylindrical bosses and dual bores
  • a6-motor-flange-01: Motor mounting flange with register boss and bolt pattern
  • a6-sprocket-blank-01: Sprocket blank with disc, raised hub, keyway, and 4-bolt circle
  • a6-pulley-01: Flanged belt pulley with narrow groove section and central bore
  • a6-compound-bore-ring-01: Thick ring with stepped counterbore from each end
  • a6-yoke-block-01: Fork yoke with cross-bore through both tines

Key Features

  • Comprehensive validation: Each task includes detailed geometric checks (bounding box, mass properties, hole detection and positioning)
  • Realistic engineering scenarios: Tasks model common mechanical components (flanges, bosses, pulleys, brackets, yokes)
  • Progressive complexity: A5 tasks focus on single features or simple combinations; A6 tasks introduce compound geometries and multi-axis features
  • Strict anti-cheesing: All tasks enforce max_solid_count: 1 to ensure proper boolean operations and single-solid output
  • Generous resource limits: A5 tasks allow up to 40,000 tokens and 50 tool calls; A6 tasks allow up to 50,000 tokens and 60 tool calls

Notable Implementation Details

  • Tasks use precise geometric specifications (e.g., bolt circle positions calculated to 3 decimal places)
  • Hole detection checks validate both diameter and position with tight tolerances (0.05–0.3 mm)
  • Mass properties and center-of-mass calculations are pre-computed with 1.0–1.5% tolerance bands
  • STEP roundtrip validation ensures CAD model persistence and format compatibility
  • Keyway and cross-bore features test advanced boolean subtraction operations

https://claude.ai/code/session_017FkXxRjwdnXmGp91TVY8pe

A5 — 8 tasks, compound geometry requiring multi-step spatial reasoning:
  u-bracket, double-d-shaft, ribbed-plate, hex-bolt-blank,
  disc-hub, hollow-cap, lightened-disc, stepped-boss-plate

A6 — 6 tasks, complex machined parts with many features:
  compound-bore-ring, sprocket-blank, motor-flange,
  yoke-block, pulley, compound-boss

All volumes computed analytically. Checks: valid_solid, bbox,
mass_props (1–2% tolerance), hole_count/positions where Z-aligned
holes are present, step_roundtrip on all.

https://claude.ai/code/session_017FkXxRjwdnXmGp91TVY8pe
@vercel
Copy link
Copy Markdown

vercel Bot commented May 5, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
mecheval Ready Ready Preview, Comment May 5, 2026 8:49pm
vcad Ready Ready Preview, Comment May 5, 2026 8:49pm
vcad-docs Ready Ready Preview, Comment May 5, 2026 8:49pm
vcad-mcp Ready Ready Preview, Comment May 5, 2026 8:49pm

Request Review

@ecto ecto merged commit 0e2a082 into main May 5, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants