xml-pipeline/xml_pipeline/librarian
dullfig ce8a9ae0e7 Add Premium Librarian MVP for codebase intelligence
Implements an RLM-powered codebase intelligence system that:
- Ingests git repositories and chunks code intelligently
- Stores chunks in eXist-db for RAG retrieval
- Answers natural language queries using LLM synthesis

New package xml_pipeline/librarian/ with:
- chunker.py: AST-based code chunking (Python, JS/TS, C++)
- ingest.py: Git clone + file walking + chunk storage
- index.py: Structural index building (files, functions, classes)
- query.py: RAG search + LLM synthesis with source citations
- primitives.py: XML payloads (LibrarianIngest, LibrarianQuery, etc.)
- handler.py: Message handlers for organism integration

Also adds GitPython and aiohttp as optional [librarian] dependencies.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-27 23:07:19 -08:00
..
__init__.py Add Premium Librarian MVP for codebase intelligence 2026-01-27 23:07:19 -08:00
chunker.py Add Premium Librarian MVP for codebase intelligence 2026-01-27 23:07:19 -08:00
handler.py Add Premium Librarian MVP for codebase intelligence 2026-01-27 23:07:19 -08:00
index.py Add Premium Librarian MVP for codebase intelligence 2026-01-27 23:07:19 -08:00
ingest.py Add Premium Librarian MVP for codebase intelligence 2026-01-27 23:07:19 -08:00
primitives.py Add Premium Librarian MVP for codebase intelligence 2026-01-27 23:07:19 -08:00
query.py Add Premium Librarian MVP for codebase intelligence 2026-01-27 23:07:19 -08:00