Ratefluencer AI Hackathon 2026 ยท Track 1 โ AI Influencer Intelligence Engine
Type a campaign brief in plain English โ get a fraud-adjusted, ROI-ranked, explainable shortlist of creators + an exportable plan.
โถ Live demo โ utkarsh805-ratefluencer-copilot.hf.space
(first analysis warms the models for ~40s, then it's instant)
Brands burn billions picking influencers by follower count. Follower count does not predict campaign success. Ratefluencer Copilot predicts the thing that actually matters โ business impact (ROI) โ sees through fake audiences, and explains every decision.
And it proves it on stage:
#1 @minimal.skin 14K followers ๐ข True-Impact 62 โ
recommended
โฎ (real micro-creators with genuine engagement rank at the top)
#22 @famous.face 512K โverified ๐ด True-Impact 6 ๐ฉ FLAGGED โ last
~54% bot audience โ projected poor ROI
A 512K verified influencer ranked dead last. An unknown 14K creator wins. Follower count, inverted โ with proof. That's the reveal.
Trained on 30,000 synthetic creators ยท evaluated on 6,000 held-out creators.
| Metric | Result | What it means |
|---|---|---|
| ๐ฏ Precision@50 | 1.000 vs 0.320 |
every one of the top-50 picks is a genuine success โ vs 32% when ranking by followers |
| ๐ ROI Spearman | 0.792 | predicted ranking order strongly matches true ROI |
| โ Success ROC-AUC | 0.963 | cleanly separates campaign winners from losers |
| ๐ก๏ธ Fraud F1 | 0.893 | catches 97% of fraud (recall 0.974) without false alarms |
| ๐ฐ Clean-creator ROI | ~6.6ร | matches the published industry benchmark |
| Score | Answers | Powered by |
|---|---|---|
๐ฏ True-Impact 0โ100 |
Will they drive ROI? | LightGBM regressor + isotonic-calibrated classifier |
๐ก๏ธ Authenticity 0โ100 |
Is the audience real? | IsolationForest + tier-relative engagement deficit + rules |
๐ค Brand-Match 0โ100 |
Do they fit THIS brief? | MiniLM embeddings + audience/category fit |
๐ฑ Growth 0โ100 |
Are they rising? | Momentum model over follower + engagement trend |
| ๐ Drivers + rationale | Why this score? | SHAP TreeExplainer + one-line explanation |
Fraud is baked into impact, not bolted on.
fraud_adjusted_reach = followers ร (1 โ bot%)is a model input โ so a big account with a fake audience scores low by prediction, not by a hard rule. The reveal is a forecast, not a filter.
Try it live (no setup): utkarsh805-ratefluencer-copilot.hf.space โ or run it locally:
# 1 ยท install dependencies
py -m pip install -r requirements.txt
# 2 ยท build the demo data (creators + reveal cases + FAISS index + fraud scores).
# Reuses the trained model โ does NOT retrain.
py models/prepare_demo.py
# 3 ยท launch the Streamlit app
py -m streamlit run app.pyThe same pipeline is also served behind a thin FastAPI bridge (api.py), so a
React + Vite single-page app can drive it. Run two terminals:
# terminal 1 ยท serve the models over HTTP
py -m uvicorn api:app --port 8000
# terminal 2 ยท run the React frontend (proxies /api โ 127.0.0.1:8000)
cd web
npm install
npm run dev # โ http://localhost:5173The React UI is fully responsive (tablet + mobile) and shares the same five screens โ brief โ working โ shortlist (the reveal) โ creator detail โ recommendation.
โ
Runs 100% offline from seeded data โ no API key required.
๐ Optional: add GEMINI_API_KEY to a .env file (see .env.example) for
LLM-written campaign summaries; without it, a built-in template is used.
โฑ๏ธ First analysis โ 40s (one-time model + embedding warm-up), instant after.
Deterministic ML in the middle, LLM only at the edges. Every score is
reproducible (global seed = 42). Two front-ends share one pipeline โ a responsive
React/Vite SPA (web/) over a FastAPI bridge (api.py), and a Streamlit app
(app.py) โ and the Data + ML layer is vendored in-repo at proj/, reached through
a single bridge: models/score_creator.py.
LAYER 4 โ PRESENTATION
React + Vite SPA (web/, responsive) ยท Streamlit app (app.py, backup)
| HTTP /api
v
LAYER 3 โ API / AGENT
FastAPI bridge (api.py) -> Orchestrator
parse -> retrieve -> score -> rank -> compose ----> LLM rationale
(Gemini / offline template)
| models/score_creator.py <- THE BRIDGE
v
LAYER 2 โ INTELLIGENCE (proj/)
True-Impact . Authenticity . Brand-Match . Growth . SHAP
LightGBM . IsolationForest . MiniLM embeddings . SHAP TreeExplainer
|
v
LAYER 1 โ DATA
SQLite (creators . features . authenticity) + FAISS vector index
^ built by the benchmark-calibrated, fraud-injected synthetic generator
Brief (plain English)
"DTC skincare . women 22-35 . India . Rs 3,00,000 . drive sales"
|
v
1. PARSE LLM -> category . audience . geo . budget . goal . tone
|
v
2. RETRIEVE embed brief -> FAISS -> top-K candidate creators
|
v
3. SCORE run 5 models on EACH candidate:
True-Impact ROI / success (fraud-adjusted)
Authenticity bot % . pods . spikes
Brand-Match fit to this brief
Growth momentum
SHAP per-score drivers (the "why")
|
v
4. RANK weighted composite + fraud guardrail
(flagged creators sink to the bottom)
|
v
5. COMPOSE budget split + rationale (LLM, or offline template)
|
v
Output: fraud-adjusted, ROI-ranked, EXPLAINABLE shortlist + export plan
BUILD TIME (one-time . python models/prepare_demo.py)
synthetic generator ---> creators + labels (ROI, success)
+ planted reveal (gem & fraud)
|
+--> feature engineering (17 features, fraud-adjusted) ---> SQLite
+--> MiniLM embeddings ------------------------------------> FAISS index
+--> authenticity engine (bot %, flags) ------------------> SQLite
QUERY TIME (per brief)
brief -> parse -> embed -> FAISS top-K
|
v
load features (SQLite) -> 5 models -> scores + SHAP drivers
|
v
rank (composite + fraud guardrail) -> recommendation
|
v
shortlist + budget plan -> UI -> export (.txt)
py models/screen_real.py # screens real Instagram accounts from public numbersThe authenticity engine needs only public data (followers + engagement), so it runs on real accounts. It's tier-aware โ the clever part:
| Account | Followers | Avg likes | Engagement | Verdict |
|---|---|---|---|---|
| @small.creator | 40K | 2,000 | 5.4% | ๐ข clean |
| @big.account | 800K | 2,000 | 0.27% | ๐ด flagged โ bots |
Identical likes, opposite verdict โ because the model judges engagement relative to audience size. (Presented as an authenticity screen, not a public accusation.)
No public dataset has campaign outcomes. Conversions and ROI live inside brands' private CRMs. So we generate a labeled creator population calibrated to documented benchmarks (engagement-by-tier, ~6.6ร industry ROI, verified-conversion uplift), with fraud injected into ~20% of profiles. We then validate fraud detection on real public accounts, where the data supports it.
"Real profiles for realism, a benchmark-calibrated synthetic generator for outcome labels โ because no one publishes conversion data."
Ratefluencer-Engine/
โโโ app.py # Streamlit entry point + design system
โโโ api.py # FastAPI bridge โ serves the pipeline to the React UI
โโโ ui/ # 5 screens: brief โ working โ shortlist โ detail โ export
โ # + real_screener.py (real-account fraud screen)
โโโ web/ # React + Vite SPA โ same 5 screens, responsive (calls api.py)
โโโ agent/ # orchestrator ยท brief_parser ยท retriever ยท ranker ยท composer
โโโ models/ # โญ ML BRIDGE: score_creator ยท prepare_demo ยท screen_real
โโโ proj/ # vendored Data + ML layer: config + src/{store,data,models} + trained model
โโโ utils/ # session ยท env loader ยท ui_kit ยท ranking
โโโ data/ # built by prepare_demo (gitignored)
โน๏ธ The Data + ML layer is vendored in
proj/(source + trained model), so a fresh clone is self-contained. Runpy models/prepare_demo.pyonce to build the demo data, then launch. (Override its location with theRATEFLUENCER_PROJenv var if you keep the ML layer elsewhere.)
| Category | Pts | How we earn them |
|---|---|---|
| AI / ML Innovation | 20 | Fraud-adjusted True-Impact + anomaly detection + SHAP + embeddings |
| Scoring Accuracy | 20 | Precision@50 1.000 vs 0.32, validated on 6,000 held-out creators |
| Viral Prediction | 15 | ROI + success probability + growth-potential model |
| Agent Design | 15 | Brief โ retrieve โ score โ rank โ recommend |
| Product Design | 10 | Decision-first UI + the reveal |
| Business Impact | 10 | Quantified wasted-spend savings (fraud โ poor ROI) |
| Technical Complexity | 5 | 5-model stack + vector search + synthetic-data engine |
| Demo | 5 | Rehearsed reveal + live real-account screen |
Built for Ratefluencer AI Hackathon 2026 ยท Predict influence before it happens.