Course Outline
Architectural Foundations for AI Systems
- Layers, boundaries, and separation of concerns
- Application of ports and adapters to AI components
- Quality attribute scenarios specific to AI features
- Use of architecture decision records for governance
Modernizing Existing Applications
- Incremental modernization over full rewrites
- Positioning AI services alongside existing monoliths
- Strangler and anti-corruption layer patterns
- Integration points for existing APIs and data
LLM Integration Architectural Patterns
- Model gateway as an abstraction boundary
- Synchronous, asynchronous, and streaming integration methods
- Fallback, degradation, and provider failover strategies
- Treating prompts and model configurations as version-controlled assets
Contracts, APIs, and Data Exchange
- Structured output schemas and validation processes
- Idempotency, retries, and rate limiting mechanisms
- Latency budgets and timeout orchestration
- Cost per request as an architectural constraint
End-to-End RAG Architecture
- Ingestion, chunking, and embedding pipelines
- Indexing, retrieval, reranking, and generation stages
- Placement of retrieval relative to application services
- Trade-offs and failure modes at each stage
Vector Databases and Retrieval Design
- Managed versus self-hosted vector stores
- Dense, sparse, and hybrid search techniques
- Metadata filtering and tenant isolation
- Re-embedding strategies when models evolve
Retrieval Quality, Grounding, and Evaluation
- Evaluation sets derived from real-world queries
- Metrics for retrieval and answer quality
- Citation, grounding, and hallucination mitigation
- Feedback loops that inform the index
Agent Architectures
- The agent loop and tool invocation mechanics
- Deterministic workflows versus autonomous planners
- Scenarios where an agent is not the optimal solution
- Defining agent responsibilities and state management
Multi-Agent Systems and Orchestration
- Supervisor and orchestrator topologies
- Handoff protocols and message contracts
- Shared memory and context management
- Comparing frameworks based on architectural merits
Service Communication and Tool Protocols
- Event-driven and queue-based coordination
- Exposing tools through standard protocols
- Sagas, compensation, and long-running transactions
- Observability across service interactions
AI Agents in Development Workflows
- Incorporating coding agents into the delivery pipeline
- Specification-driven development and review gates
- Test generation and automated quality checks
- Guardrails that maintain architectural control
Governance and Software Quality
- Design reviews for AI features
- Management of model and prompt changes
- Regression evaluation as a pipeline stage
- Ownership, policy, and approval pathways
Security, Privacy, and Data Governance
- Prompt injection and defense-in-depth strategies
- Secrets management, access control, and least privilege
- Data residency, personal data handling, and retention
- Auditability and human-in-the-loop controls
Scalability, Cost, and Observability
- Tracing across agent chains
- Token and cost telemetry
- Caching and latency optimization
- Service levels and incident response for AI services
Capstone: Architecture for an AI-Driven Solution
- Context, component, and deployment views
- Design of retrieval and agent orchestration
- Security, governance, and cost planning
- Peer review, critique, and migration roadmap
Requirements
- Proven experience in designing and maintaining production software systems
- Practical knowledge of REST APIs and service integration
- Understanding of relational databases and data modeling
- Basic familiarity with LLM-based tools or APIs
Target Audience
- Software architects
- Technical leads and senior engineers
- Engineering managers accountable for architectural decisions
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny