dullfig/xml-pipeline
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
xml-pipeline/xml_pipeline
History
dullfig 8b11323a8b Add token budget enforcement and usage tracking 
Token Budget System:
- ThreadBudgetRegistry tracks per-thread token usage with configurable limits
- BudgetExhaustedError raised when thread exceeds max_tokens_per_thread
- Integrates with LLMRouter to block LLM calls when budget exhausted
- Automatic cleanup when threads are pruned

Usage Tracking (for production billing):
- UsageTracker emits events after each LLM completion
- Subscribers receive UsageEvent with tokens, latency, estimated cost
- Cost estimation for common models (Grok, Claude, GPT, etc.)
- Aggregate stats by agent, model, and totals

Configuration:
- max_tokens_per_thread in organism.yaml (default 100k)
- LLMRouter.complete() accepts thread_id and metadata parameters

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-27 21:07:43 -08:00
..
config Rebrand Nextra → OpenBlox 2026-01-27 20:31:13 -08:00
crypto Add Ed25519 envelope signing infrastructure 2026-01-27 20:00:35 -08:00
listeners Rename agentserver to xml_pipeline, add console example 2026-01-19 21:41:19 -08:00
llm Add token budget enforcement and usage tracking 2026-01-27 21:07:43 -08:00
memory Add shared backend for multiprocess pipeline support 2026-01-20 20:18:22 -08:00
message_bus Add token budget enforcement and usage tracking 2026-01-27 21:07:43 -08:00
platform Archive obsolete docs and misc cleanup 2026-01-20 20:20:10 -08:00
primitives Add Sequence and Buffer orchestration primitives 2026-01-25 14:56:15 -08:00
prompts Rename agentserver to xml_pipeline, add console example 2026-01-19 21:41:19 -08:00
schema Rename agentserver to xml_pipeline, add console example 2026-01-19 21:41:19 -08:00
server Add capability introspection REST endpoints 2026-01-27 20:51:17 -08:00
tools Rename agentserver to xml_pipeline, add console example 2026-01-19 21:41:19 -08:00
utils Rename agentserver to xml_pipeline, add console example 2026-01-19 21:41:19 -08:00
__init__.py Move console, auth, server to Nextra (v0.4.0) 2026-01-19 22:37:21 -08:00
cli.py Add AgentServer REST/WebSocket API 2026-01-27 20:22:58 -08:00