Skip to content

Feat/improvements#28

Merged
Mark-0909 merged 4 commits into
mainfrom
feat/improvements
Apr 15, 2026
Merged

Feat/improvements#28
Mark-0909 merged 4 commits into
mainfrom
feat/improvements

Conversation

@jomkv

@jomkv jomkv commented Apr 15, 2026

Copy link
Copy Markdown
Member

Added

  • Hybrid entity matching via existing NER model + gazette keyword list (using constants/gazetteer.pkl). Should now be able to catch lower cased entities.
  • Improved aggregation logic.

Current accuracy scores

Normal: 77% (^1%)
Negated: 84% (^2%)

Note

Github action accuracy scores might be a little lower due to DB differences.

@jomkv jomkv requested a review from Mark-0909 April 15, 2026 10:36
@github-actions

github-actions Bot commented Apr 15, 2026

Copy link
Copy Markdown
## Accuracy Check Results

- Normal dataset (jomTestCases): **71.72%** (71/99)
- Negated dataset (negatedClaims): **81.82%** (81/99)

- Evaluation step outcome: success/success
- Run: https://github.com/jomkv/truescope-api/actions/runs/24452748488

@Mark-0909 Mark-0909 merged commit d45a8e5 into main Apr 15, 2026
1 check passed
@jomkv jomkv deleted the feat/improvements branch April 24, 2026 10:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants