Skip to content

Feat/deployment preparations#30

Merged
jomkv merged 12 commits into
mainfrom
feat/deployment-preparations
Apr 23, 2026
Merged

Feat/deployment preparations#30
jomkv merged 12 commits into
mainfrom
feat/deployment-preparations

Conversation

@jomkv

@jomkv jomkv commented Apr 22, 2026

Copy link
Copy Markdown
Member

Added

  • Docker setup for deployment at VM
  • Adjusted threads and concurrency to handle heavy load
  • Optimized remarks generation by removing BART completely
  • Excluded model training endpoint on prod as it is used during development only

TODO

  • Optimize resource usage, VM's CPU is always under heavy load during concurrent requests (which is expected). If we can find a way to shift more of the workload to the memory that would be great
  • Investigate why accuracy scores are lower when using deployed DB

I'll test this branch on the VM tomorrow to see if anything broke, just wanted to create a PR ASAP so the accuracy test can run on github action while I sleep 😃

@jomkv jomkv requested a review from Mark-0909 April 22, 2026 15:33
@github-actions

github-actions Bot commented Apr 22, 2026

Copy link
Copy Markdown

Accuracy Check Results

Accuracy evaluation did not produce summary JSON in step output.

@Mark-0909

Copy link
Copy Markdown
Collaborator

Goods for me

@jomkv jomkv merged commit d6028ec into main Apr 23, 2026
1 check passed
@jomkv jomkv deleted the feat/deployment-preparations branch April 24, 2026 10:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants