Hey Guru we need Senior Backend AI Orchestration Engineer (Private Infrastructure)
We are seeking a highly trusted senior backend engineer to architect and implement a private orchestration service powering a connected consumer hardware platform.
This role focuses on secure AI routing infrastructure, internal service orchestration, model abstraction layers, session handling, and scalable backend intelligence systems.
This is a confidential infrastructure role involving private server-side systems and production-grade API architecture.
Required Skills
Python
FastAPI or equivalent async backend framework
PostgreSQL
Redis
Docker
REST APIs
Async architecture
WebSockets or streaming responses
Production infrastructure experience
API security best practices
Experience integrating LLM providers
Preferred Experience
OpenAI API
Anthropic API
OpenRouter
LangChain / LlamaIndex
AI orchestration systems
Multi-model routing
Vector databases
Prompt pipeline systems
GPU/local model infrastructure
High-concurrency backend systems
Infrastructure Responsibilities
Internal private API services
Provider abstraction layer
Prompt/configuration management
Session persistence
Rate limiting and monitoring
Secret management
Logging and observability
Deployment architecture
Important Notes
This is a highly confidential infrastructure role
NDA and IP assignment required
All development occurs within company-controlled repositories and environments
Strong operational security practices required
Experience working with sensitive startup infrastructure preferred
Deliverables
Production-ready orchestration service
Internal API architecture
Provider integration layer
Secure configuration system
Deployment documentation
Monitoring/logging setup
Scalable modular architecture
Full source code handoff
Please apply I will provide all details after NDA and hire confirmation
... Show more