Skip to content
View asadani's full-sized avatar
👨‍💻
It’s not a bug, it’s a hallucination.
👨‍💻
It’s not a bug, it’s a hallucination.

Block or report asadani

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
asadani/README.md

Anuj Sadani

People · Business · Technology

Principal Engineer at Infrrd. I build AI systems and the teams that build them: enterprise document AI at production scale, and the engineering standards that keep it running.

Architecting Around Entropy


What I work on

  • GenAI and machine learning architecture for a document extraction platform processing roughly 1M pages per day
  • Agent tooling on the Model Context Protocol, and model routing and fallback across providers
  • Fine-tuning small open models, evaluation harnesses, and treating cost per page as a first class metric
  • Organization wide Python engineering standards across multiple teams

Technologies & Tools

Generative AI and agents

RAG Agentic Systems MCP Tool Design & Gating Prompt Engineering Context Engineering Model Evaluation LLMs SLMs Vision-Language Models Embeddings Vector Databases

Agent and LLM frameworks

LangChain LangGraph LlamaIndex CrewAI PydanticAI DSPy Claude Code

Models, serving and routing

AWS Bedrock Amazon SageMaker Vertex AI vLLM Ollama LiteLLM OpenRouter Hugging Face Multi-Provider Routing

Training and data

Fine-tuning LoRA QLoRA Quantization Synthetic Data YOLO OCR spaCy Databricks

Backend and architecture

Python FastAPI Flask REST APIs Microservices Design Patterns RabbitMQ PostgreSQL MongoDB

Cloud and infrastructure

AWS Docker Kubernetes Terraform Helm Linux

CI/CD and observability

GitHub Actions Jenkins Argo Git Grafana Kibana New Relic Postman Automated Testing

Ways of working

Technical Roadmaps Architecture Ownership Hiring Mentoring Performance Development Delivery Ownership Stakeholder Communication Cost Optimization Design Thinking Jira Confluence


Research

Tool Attention Is All You Need Dynamic tool gating and lazy schema loading for scalable agentic workflows. arXiv:2604.21816 · repo

Locale-Conditioned Few-Shot Prompting for On-Device PII Substitution Mitigating demonstration regurgitation with small language models. arXiv:2605.13538 · repo

The Great Recalibration The 2026 pivot from generalist wrappers to application layers and industrialized AI services. SSRN:6071412

Patents

Three pending applications with the United States Patent and Trademark Office, on query optimization and entity extraction from documents: 19/375,298, 19/375,285, 19/432,186.


Building

Tools and plugins

  • research-anything — verified research pipeline: sources captured, claims bound to exact quotations, gated before anything ships
  • content-repurposer-skill — Claude Code plugin for drafting technical content in your own voice
  • openai-privacy-filter-benchmark — benchmark and inference harness for OpenAI's open-source PII detection model
  • book-forge — build pipeline turning HTML into folio-stamped, self-audited PDF

On PyPI (all packages)

  • excel-form-extractor — extract checkboxes and dropdowns from .xlsx and .xls files, zero runtime dependencies
  • zenofai — the Zen of GenAI, printed on import
  • quote-ondemand — fetch a quote from the internet

Writing


Fun Facts & Quotes

"When I wrote the code, only God and I knew how it worked. Now God alone knows!" — The eternal truth of legacy code

0.1 + 0.2 != 0.3 — It's caused by how they are stored in hardware. Read: Floating-point arithmetic

"The aim of the wise is not to secure pleasure, but to avoid pain." — Aristotle

"Architecting around entropy" — Managing complexity in distributed systems


Connect

LinkedIn Medium Substack PyPI

Pinned Loading

  1. tool-attention tool-attention Public

    Tool Attention Is All You Need: dynamic tool gating and lazy schema loading for eliminating the MCP/tools tax in scalable agentic workflows (arXiv:2604.21816)

    TeX 32 4

  2. openai-privacy-filter-benchmark openai-privacy-filter-benchmark Public

    Benchmark and inference harness for openai/privacy-filter, OpenAI's open-source PII detection model

    Python 3

  3. content-repurposer-skill content-repurposer-skill Public

    Claude Code plugin: draft technical content (LinkedIn, newsletter, GitHub Pages, Medium, Substack) in your voice — no marketing fluff. Fork-friendly voice profile.

    Shell 1

  4. ai-engineer-learning-hub ai-engineer-learning-hub Public

    AI Engineer Learning Hub — principal-level study notes for AI-era engineers, clustered, cross-linked, and sourced (MkDocs Material site).

    Python

  5. docker_the_right_way docker_the_right_way Public

    Roff

  6. research-anything research-anything Public

    Claude Code plugin for verified research: sources captured and hashed, every claim bound to an exact quotation, gated before anything ships

    Python