AI assembly systems

Roger Murphy

I build working agentic software: multiple bots on multiple harnesses, workflow-driven collaboration, model optimization, remote execution, and real applications that prove the runtime is more than a chat window.

5 harnessesCodex, Claude Code, Gemini, Cline, CrewAI
40+ providersHosted and local LLM options
31 toolsGoverned registry across 16 categories
Docker + K8sWindows, Compose, and cluster paths
Screenshot of Career Hunter insights with pipeline and job market analytics
Career Hunter: role corpus, fit thresholds, salary signal, and application funnel.
Screenshot of Presentation Studio with templates and generated deck preview
Presentation Studio: AI-guided outline to real PowerPoint deck.
Flagship project

OSHAL is Roger's demonstration of AI assembly.

Open Swarm Harness Agent LLM is a beta multi-tenant, multi-user, multi-agent runtime where specialized bots can run different agent harnesses, use different model providers, coordinate over a Redis Streams mesh, and register new apps, tools, agents, and workflows while the swarm is running.

The point is practical: turn agentic AI from one clever prompt into a governed operating layer with user and tenant boundaries, tickets, roles, tools, connector-backed data access, cost attribution, review gates, deployment options, and applications people can actually use.

TypeScript Node.js Redis Streams Postgres ChromaDB RAG Docker Compose Kubernetes OIDC / Keycloak Multi-tenant Multi-user Connector token broker A2A remote agents Local LLMs
Proof points

Not a chatbot wrapper. A working swarm runtime.

The current OSHAL materials show a broad system: build automation, incident RCA, bot generation, education workflows, connector-backed communication intelligence, external data/action connectors, remote node control, and model optimization.

26registry bots in the current beta snapshot
68persona definitions for role-specific execution
18dynamic tools, agents, and containers launched in a validation pass
~68%lower SAP HANA RCA cost in one persona-gated path versus two-bot review

Build swarm

Ticket intake routes through planning, architecture, implementation, testing, review, and delivery with dedicated bots for each role.

RCA swarm

Incident workflows produce root-cause analysis, impact assessment, remediation steps, rollback planning, and scripts.

Bot Forge

Codex-packer interviews an operator, emits a persona plus swarm app manifest, and injects a focused bot into the running swarm.

Optimization loop

AI calls can be replayed and compared across models for cost, latency, tokens, and judged quality so the cheapest accurate path can be found.

Per-bot configuration

Every bot can choose its harness, provider, model, and tools.

OSHAL does not force the swarm into one provider or one runtime. Each bot can be configured for a working harness, API provider, and model under that provider while still using the same bot-to-bot communication layer and standard framework tools.

Harness per botA tutor, planner, incident responder, or build worker can run through the harness that fits its job.
Provider and model per botProvider choice and model choice are runtime configuration, not hard-coded architecture decisions.
Shared swarm communicationBots keep the same A2A and workflow messaging even when their underlying harnesses or models differ.
Tool policy per botStandard framework tools remain available, with auth and execution modes configured on a bot-by-bot basis.
Screenshot of OSHAL per-bot configuration showing class-tutor harness API provider model provider authentication and tool auth modes
Real screenshot supplied from OSHAL: class-tutor configured with an OpenAI Codex API, GPT-5.4 model, provider authentication, selector skills, and per-tool auth modes.
Feature inventory

Other capabilities surfaced in the OSHAL codebase.

These are the pieces that make the project interesting to hiring teams: not just AI calls, but the surrounding engineering needed to run, govern, and extend agentic systems.

Runtime

Per-bot harness and model config

Each bot can choose its harness, API provider, model, selector skills, provider auth, and tool modes while still joining one coordinated workflow.

Manifests

Loadable swarm apps

YAML app bundles declare bots, routes, tools, UI ribbon entries, migrations, voices, themes, and workflows.

Expansion

Dynamic bot and tool creation

Tools and agents can be registered into a running swarm, launched as containers, heartbeated, and made visible in the registry.

Remote

A2A and remote nodes

Remote clients and daemon-style nodes can register, receive commands, bridge local tools, and join the swarm over private transports.

Operations

Cockpit observability

Operator surfaces include task explorer, queues, mesh dashboard, ops, health, Redis visibility, logs, and RAG center.

Assistant

Unified OSHAL Assistant

Jarvis provides a front door into the swarm, routing requests across specialist apps, command center signals, voice, text, and workflow actions.

Connectors

Prebuilt data and action connectors

Connector patterns cover Google Workspace, social publishing, SmartThings and Nest, Dropbox, GitHub, GCP, Plaid finance, and payments, with token brokering scoped per user.

IoT

Connected home control

Smart Home connects OSHAL to device state, SmartThings scenes, schedules, timers, and natural-language home commands.

Governance

Cost, tokens, and tool policy

Cost attribution is recorded per bot and call, with tool access controlled per agent through auto, ask, and off modes.

Knowledge

RAG and memory surfaces

ChromaDB collections, provenance-aware citations, uploaded class materials, and SAP or infra runbooks can ground bot output.

Reliability

Scheduling and self-healing

Cron-backed scheduling, heartbeats, stuck-agent watchdogs, re-registration, health monitoring, and stale-channel cleanup are part of the runtime.

Security

Multi-tenant, multi-user scoping

Tenant-aware apps, OIDC, production Keycloak patterns, user-scoped stores, connector token handling, and auth-gated routes keep execution accountable.

Comms

Email and social intelligence

Google Workspace digests, Gmail triage, calendar context, LinkedIn draft and publish flows, and social signals run through a communications bot.

Career

Career memory and tailored resumes

Career Hunter builds a structured bank from files, notes, and spoken context, then pulls the right experience into job-specific resumes and cover letters.

Decks

Presentation generation

Presentation Studio creates real PowerPoint decks from templates, topics, or outlines, with AI guidance and Dropbox, Git, local, or download storage paths.

Education

Little Monsters app

A six-bot learning app handles lecture recording, transcription, flashcards, tutoring, textbooks, study plans, writing help, and presentations.

Deployment

Runs close to the work

OSHAL supports Windows, Docker Compose, Kubernetes, local models through Ollama or LM Studio, and remote command execution.

How it works

A ticket becomes coordinated work.

OSHAL's architecture is built around clear ownership: the controller routes and observes; bot nodes execute; personas define role behavior; the mesh carries work between agents.

1. Intake
A ticket, alert, upload, or operator request enters the system. The workflow selects the right app, ticket type, and phase sequence.
2. Route
The controller dispatches envelopes over the mesh. Agents consume their own streams, so lanes can scale independently.
3. Execute
Bot nodes run the LLM work. Each bot can use its harness, tools, persona, model, and connector context to read approved data or perform approved actions.
4. Govern
Results, tokens, cost, handovers, and review state are captured. Human gates stay available where they matter.
Live application proof

Little Monsters turns the swarm into a student-facing learning product.

Little Monsters is the education app riding on OSHAL: a multi-bot student workspace for lectures, study loops, tutoring, flashcards, quizzes, class management, and presentation generation.

Student dashboardProgress, streaks, lectures, class actions, and study status live in one cockpit surface.
Lecture to study loopRecordings can be captured, transcribed, replayed, and turned into review material.
Practice surfacesFlashcards, quiz practice, tutor chat, and class bank flows make the agents useful to students instead of only operators.
Shared platform capabilityThe same Presentation Studio deck generator is available inside the learning app and as its own OSHAL app.
Screenshot of Little Monsters student dashboard with study stats, quick actions, recent lectures, and class tools
Real screenshot supplied from Little Monsters: student dashboard, quick actions, lecture replay, study stats, and class controls.
Live application proof

Career Hunter turns your experience into a living career bank.

Career Hunter is not just a job board. It builds a database of your career history from files, notes, and conversations, then uses that experience bank to score roles, surface relevant stories, and write tailored resumes and cover letters for the specific job.

Career memoryUpload files, speak into the system, and add notes so your accomplishments, project stories, skills, and context become reusable structured data.
Job-specific resumesFor each role, it pulls the most relevant experience from your bank and drafts a resume and cover letter matched to the posting.
Experience extractionWhen a job exposes a gap, the app asks targeted questions and turns your answers into future resume material.
Pipeline intelligenceScored jobs, recruiters, approvals, fit thresholds, salary signal, company breakdown, and funnel analytics stay tied to your profile.
Screenshot of Career Hunter insights with pipeline funnel and job market analytics
Real screenshot supplied from Career Hunter: insights over the role corpus, fit thresholds, salary signal, company breakdown, and pipeline funnel.
Live application proof

Presentation Studio turns an AI conversation into a real PowerPoint deck.

The deck generator runs as a standalone OSHAL app and inside Little Monsters. You can start from a template or topic, work with the deck-builder agent to shape the outline, then generate a real .pptx for storage or download.

AI-guided deck craftThe agent helps move from a rough idea to title, outline, slide sections, and bullets before generation.
Template or topicPitch, strategy review, project update, teaching, blank, and AI-drafted deck starts are all supported.
Real outputThe workflow generates actual PowerPoint .pptx files rather than a static preview or mock slide outline.
Storage choicesDecks can flow through Dropbox, Git-backed storage, local files, OSHAL storage, or direct download.
Screenshot of Presentation Studio with deck templates, AI deck generation, My decks, and download controls
Real screenshot supplied from Presentation Studio: template starts, topic-to-deck generation, deck previews, and download-ready .pptx output.
Applications

Working demos and signed-in surfaces.

The portfolio is strongest when people can open the work. Some apps are public prototypes; OSHAL cockpit surfaces are intentionally auth-gated.

OSHAL Apps Dashboard

OSHAL
Screenshot of OSHAL applications dashboard with manifest controls, focus selector, and active app cards

The manifest-driven app dashboard for loading swarm apps, importing YAML, focusing a cockpit surface, and toggling active application bundles.

Open gallery ->

OSHAL Assistant

OSHAL app
Screenshot of OSHAL Assistant Jarvis cockpit with voice controls and command center

The Jarvis cockpit surface: voice and text entry into the swarm, command center signals, app routing, and assistant-led workflow starts.

Open cockpit ->

Smart Home Control

OSHAL app
Screenshot of Smart Home cockpit with scenes, schedules, devices, and chat command input

Connected-home control for SmartThings devices, scenes, schedules, timers, and natural-language commands like make it cozy.

Open cockpit ->

Little Monsters

OSHAL app
Screenshot of Little Monsters student dashboard with lectures and study actions

A learning workflow app for classes, recorded lectures, flashcards, tutor chat, OCR, retrieval, and presentation generation.

Open cockpit ->

Presentation Studio

OSHAL app
Screenshot of Presentation Studio creating a PowerPoint deck from templates and an AI prompt

AI-assisted deck creation with templates, topic-to-outline drafting, real .pptx generation, deck storage, and direct download.

Open cockpit ->

AI Optimize

Public
Screenshot of the AI Optimize cost and token race application

A model comparison lab for prompts, cost, latency, tokens, answer quality, and exportable optimization reports.

Open demo ->

Career Intelligence

OSHAL app
Screenshot of Career Hunter insights and job pipeline analytics

A career-history bank that accepts files, notes, and voice context, then scores jobs and drafts tailored resumes from the most relevant experience.

Open cockpit ->

Project Planner

Sign-in
Screenshot of the AI Plan project planning application sign-in surface

Goal-to-plan decomposition with phases, tasks, dependencies, and an agent-assisted program-control loop.

Open demo ->
Why this matters

This is a portfolio of engineering judgment.

OSHAL shows platform thinking, but the surrounding apps show product delivery: user interfaces, authentication, databases, queues, connectors, LLM economics, deployment, observability, and operational safety.

1
Systems builderConnects agents, queues, data, UI, tools, and infrastructure into working products.
2
AI pragmatistOptimizes for cost, correctness, reviewability, and model flexibility instead of vendor lock-in.
3
Full-stack operatorMoves between TypeScript, Python, Docker, Kubernetes, auth, databases, and frontend UX.
4
Product-minded engineerTurns platform capability into demos people can test, critique, and reuse.

Looking for senior AI platform, full-stack, or automation roles.

Agentic Federal is the proof bench. OSHAL is the flagship. Roger is available to talk about roles where practical AI systems, workflow automation, platform engineering, and product delivery all meet.