Cloud Platform
- Custom Domain Support: Full support for custom domains with CNAME configuration, backfill scripts, and domain target management
- Domain Diagnostics: New diagnostic tools to troubleshoot domain configuration issues
- API Key Management: Enhanced API key creation dialog with security warnings
Workspace Administration
- Complete Workspace Admin: New comprehensive workspace management interface with team transfer capabilities
- Telegram Integration: Added Telegram bot integration with debug admin UI for better monitoring
- Bulk Communication: Implemented bulk email system with comprehensive reporting
Infrastructure & Performance
- API Rate Limiting: Implemented comprehensive rate limiting system for platform stability
- Session Management: Enhanced session pattern validation with new checks
- Database Optimization: Updated PostgreSQL connection pool settings and session management patterns
- Navigation: New single-search-selector component and improved admin navigation
Bug Fixes
- Fixed multiple session-related issues and API key creation errors
- Resolved authentication service context problems
- Improved error handling for asyncio operations
UI/UX Improvements
- Resource Section Redesign: Split resource section into multi-piece components for better organization
- Storage Management: New storage filesystem selector component
- Team Admin Prototype: Initial implementation of team administration interface
- Filter Enhancements: Server-side filter options with remote search capability
Infrastructure
- SDK Integration: Switched to using SDKs to reduce maintenance overhead
- Timeout Support: Added timeout configuration to BaseClient for better reliability
- Field Tracking: Improved tracking system for consistent compose hash generation
Bug Fixes
- Prevented potential row deadlocks with improved transaction commits
- Fixed multiple Sentry-reported production issues
- Resolved storage initialization and node filtering problems
GPU Management
- GPU Allocation System: New CvmGpuAllocation model with dynamic allocation and release mechanisms
- Resource Separation: Split CPU and GPU in resource section for clearer management
- Reallocation Support: Added GPU reallocation for CVM start operations
Task Queue System
- Celery Integration: Implemented Celery-based task queue for async operations
- Queue Monitoring: Added task queue state monitoring in admin dashboard
- Worker Management: Split queue workers by workload type with control commands
- Task Cancellation: Ability to cancel in-progress tasks for stop/remove operations
Security
- Added signature support for public TCB info and secure time
- CustomerIO integration for user tracking and analytics
KMS Integration
- KMS Contracts: New kms_contracts table and kms_type support
- KMS Admin: Enhanced admin interface for KMS and contract management
- Version Compatibility: Added v03x_only flag for API compatibility checks
- Upgrade Callbacks: KMS upgrade callback URL detection for version management
Infrastructure
- Inventory System: Proof of concept for new inventory-based allocation
- Node Management: Added deleted_at to nodes with soft deletion support
- Infrastructure Actions: New VMM connection capabilities
- Announcement Scoping: Scoped announcements with CTA button support
Workspace & Teams
- Workspace Introduction: New workspace system with improved team management
- GPU Admin: Comprehensive GPU administration interface
- Instance Types: Database-driven instance type management replacing hardcoded rates
- Model Workload: Support for creating and deploying model workloads
Infrastructure
- Build Improvements: Migration from Black to Ruff for code formatting
- Python 3.13: Upgraded to Python 3.13 with better type safety
- GPU Allocation: Improved GPU allocation and reallocation mechanisms
- Resource Computation: Node-based available resource computation
Billing System
- Metered Usage: Renamed billing_records to metered_usages for clarity
- Idle Disk Usage: Enabled aggregate idle disk usage tracking
- Instance Types Admin: New admin interface for instance type management
Infrastructure
- Inventory Tables: Created nodes table and associated inventory structures
- Node Migration: Added node_id to associate tables for better resource tracking
- Authorization: New AuthGuard implementation with announcement banner
Bug Fixes
- Fixed KMS authentication API for upgrade scenarios
- Resolved audit logging and update environment variable issues
- Improved compatibility checks across the platform
Features
- Trust Center Integration: Added app attestation API for trust center functionality
- Separate Billing: Computing resource and storage now billed separately
- Public GPU TEE Page: New public-facing page showcasing GPU TEE capabilities
- API Proxy: Enhanced HTTP header handling in API proxy routes
Performance
- Backoff Configuration: Configurable timeout for exponential backoff
- Network Management: Improved network service resource management and error handling
KMS Integration
- Project Slugs: Added unique project slugs within teams
- Gateway Slugs: New gateway slug system for better identification
- Multi-KMS Support: Fixed environment encryption for multi-KMS nodes
- KMS Display: Show KMS name in CVM cards for better visibility
Features
- API Token Teams: Added team_id to api_tokens for team-based access
- Mava Widget: Integrated Mava widget for user support
Security Features
- Two-Factor Authentication: Complete 2FA implementation with backup codes
- Session Management: Session versioning and password history tracking
- OAuth Tracking: Track OAuth login device and IP information
- Security Headers: Added CSP and X-Frame-Options headers
KMS Updates
- Quote Collateral V3: Added PKC CRL and root CA CRL support
- Health Checks: Decoupled KMS and gateway health checks from VMM
UI/UX
- Password Management: New password update form with show/hide functionality
- Admin Session Tools: Session management interface for administrators
KMS Flexibility
- User KMS Selection: Users can now decide which KMS to use for their CVMs
- Gateway Integration: Added gateway_url and gateway_admin_rpc_url to KMS
- KMS Relationships: Created relationship table between teepods and KMS with soft deletion
- App ID Management: New obtain_app_id functionality
Infrastructure
- API Token Versioning: Added default_version for ApiToken
- Build System: Fixed Node.js polyfills and build configurations
- Wallet Security: Separated encryption keys for wallet management
Workspace & Teams
- Reserved Nodes: Teams can now have reserved nodes for dedicated resources
- Team Migrations: Comprehensive migration system for team members and node associations
- Billing Audit: New billing audit system for transaction tracking
Features
- Password Setup: Users can set up passwords and update usernames
- Startup Program: New startup program page for eligible teams
- CalForm Integration: Integrated calendar form for scheduling
Authentication
- OAuth Support: Added OAuth integration with GitHub and Google
- Account Linking: Users can link and unlink OAuth accounts
- Near Protocol: Added Near protocol registration and login API
KMS Features
- KMS Pagination: Pagination info in KMS list API with detail endpoints
- Maintenance Mode: UI support for maintenance mode
- Unit Input Component: New unit input component for better UX
Bug Fixes
- Fixed Gateway Admin RPC incompatibility
- Resolved node maintenance restrictions for resize operations
- Improved soft ban handling for CVMs
API Development
- Boot Auth API: New boot authentication API for secure VM initialization
- KMS List API: List available KMS with slug support
- Available Resources: API now returns remaining available resources and tier thresholds
Features
- Node Maintenance: Maintenance mode switch for node management
- Tier Limits: Updated resource limits for each tier (free, pro, enterprise)
- KMS Slugs: Support for using KMS slugs in API calls and admin CRUD
- Docker Compose Checker: Script to validate docker-compose patterns
UI/UX
- CalCom Integration: Added CalCom meeting form for support scheduling
- KMS Slug Display: Show KMS slugs in APIs and UI pages
GPU Management
- Model Validation: Added model_id validation for GPU instance creation
- Workload Filtering: Filter workloads by various criteria
- Proxy Log URL: Support for proxy log URL via environment variable
UI/UX
- Chat & Verify: Added chat and verify buttons in CVM detail pages
- URL Checker: New useUrlChecker hook for validation
- Delete Callbacks: Custom navigation callbacks for delete dialogs
Billing System Evolution
- Team Billing Fields: Prepared fields for moving from user-based to team-based billing
- Stripe Integration: Added stripe_customer_id and payment method tracking to credits
- Team Tiers: Added more TeamTier values for flexible pricing
Admin Tools
- Search Query Builder: New component for building complex search queries
- Enhanced Admin Panels: Search-query-builder integration for CVMs, users, and instance events
- Invoice Admin: AI-generated order administration interface
UI/UX
- Logs & Containers: Merged logs and containers view for better UX
- Compose File Editing: Edit and reset functionality in CVM create form
CVM Operations
- Scheduled Deletion: Added scheduled delete time functionality for automatic CVM cleanup
- Patch API: New patch-style API alongside legacy CVM upgrade API
- Context Logging: Task context logging with contextvars for better debugging
Monitoring
- Sentry Alerts: Enhanced Sentry alert integration
- CustomerIO Sync: Sync all users to CustomerIO for analytics
UI/UX
- Eliza Auto-fill: Auto-fill RedPill API keys in Eliza builder
- GPU Feature Flag: Admin-controlled GPU CVM creation feature flag
Major Features
- CVM Replica: New replica functionality to clone CVMs with same configuration
- H200 Shared Instances: Special handling for h200.shared instances preventing stop/restart
- Region Identifiers: Show region identifier in node select list and APIs
- Instance Type Billing: Added instance_type with updated billing rate calculations
API Enhancements
- Replica API: New API endpoints for CVM replication
- Latest Status: Support for latest Teepod status API
- CVM Lists: API for listing CVMs under an app and their replicas
Admin Tools
- Gateway Admin Client: New GatewayAdminClient with transitional solution
GPU Features
- GPU CVM API: New API to create GPU-powered CVMs
- GPU Stats: Added GpuSpecs type and GPU system info support
- Region Editing: Edit region identifiers for nodes
Event Tracking
- CustomerIO Integration: Track major events with CustomerIO
- Event Emission: Both create and start operations emit cvm_running event
Features
- Project Encryption: Set app_id_salt, encrypted_env_pubkey, and kms_id to projects
- Dev Image Support: Support for setting passwords in dev images and expose DSTACK_APP_ID
- Hashid Support: Added hashid support for senseless identifiers
Admin Tools
- Node Management: Comprehensive node management APIs and admin interface
GPU Infrastructure
- GPU Project Provisioning: Server-side GPU project provisioning support
- GPU CVM Card: Enhanced GPU CVM card and stats display
- GPU Deployment UI: Complete UI components for GPU deployment
- GpuBasicStats: New GPU statistics tracking
Features
- Template Section: Added template section for quick deployments
- Ollama Hub Service: Integration with Ollama Hub
- ClickHouse: Database initialization script for analytics
- Env Keys Tracking: Metadata tracking for environment keys in deployment APIs
Infrastructure
- PDM: Switched to PDM for dependency management
- CustomerIO SDK: Added CustomerIO SDK for marketing integration
KMS Features
- KMS on Launch: On-chain KMS integration when launching CVMs
- KMS Compose Updates: KMS integration for compose file updates
- KMS App Config: New KMS app configuration drawer
- KMS List: Returns KMS list in available nodes query
- Proxied API: Proxied get_app_env_encrypt_pubkey API through KMS
Refactoring
- KMS Hooks: Refactored KMS hooks with type safety utilities
- Network Hooks: Simplified to use chainId instead of networkConfig
- Blockchain Operations: Renamed useBlockchainOperations to useTx
Bug Fixes
- Fixed salt synchronization issues
- Resolved tproxy settings in AppCompose migration
- Fixed OS image duplication checks
API Development
- Compose Validation: Docker-compose validation on compose endpoints
- New Provision API: Raw dstack vmconfiguration provision API
- App-Compose Update: New API for CVM app-compose updates
- Collateral API: Enhanced collateral API with compatibility helpers
Features
- OS Image Tracking: Save os_image_id when creating CVMs
- KMS Configuration: Added kms_urls and gateway_urls to VmConfiguration
- Post-Paid Flag: Added is_post_paid flag to credits
- Image Hash: Renamed mr_image to os_image_hash for clarity
Infrastructure
- Test Coverage: Added test-coverage report in pull requests
- Modular CVMs API: Cut CVMs API into manageable chunks
Admin Tools
- KMS CRUD: Complete CRUD API and admin view for KMS management
- OS Image CRUD: Complete CRUD API and admin view for OS images
- Order Processing: Manual order status handling in admin
Database
- KMS Table: New table for KMS with fmspc and device_id
- OS Image Table: New OSImage and NodeOsImage tables
- Scheduled Tasks: sync_stripe_order_status and auto_fix_cvm_status
Infrastructure
- Python 3.13: Updated required Python version to 3.13+
- Preflight Refactor: Moved CVM launch and resize checks to preflight
Security Features
- Email Verification: New users must verify email before continuing
- Turnstile CAPTCHA: Cloudflare Turnstile integration for registration
- Registration Limits: API registration restrictions with frontend-only flow
- IP Audit Logs: Save IP and user agent upon successful registration
Eliza Integration
- Version Support: Added Eliza v0.1.9-patch.2 and v0.25.9
- Mira Provider: Added Mira as model provider in Eliza builder
Fraud Prevention
- Telegram Bot: Alert system for possible fraud order detection
- Email Reachability: Track email reachability in registration logs
Billing System
- Stripe Webhooks: Save Stripe webhook logs to ClickHouse for audit
- Order Sync: Added sync_purchased_orders functionality
- Stripe Service: Handle charge refunds through StripeService
- Rate Limiting: Registration rate limit of 2 accounts per hour
Security
- DCAP Attestation: Added DCAP attestation upload and verify API
- Proof API: Compatible API for proof.t16z.com integration
Infrastructure
- Redis Management: Improved Redis connection management with aclose
- Type Annotations: Enhanced type notations for SQLAlchemy models
Billing Features
- Coinbase Commerce: Setup billing flow for Coinbase callback
- Email Templates: Jinja2 mailing template solution with staging tests
- Payment Dialog: Dialog for Coinbase billing facts
UI/UX
- MCP Hosting: Sub-pages and TypeForm integration for MCP hosting
- Command Copy: Copy button for CommandLine component in LaunchTab
Technical
- Quote Parser: SGX extension parser for quote validation
- Viber Coding: KMS controller and app controller viber implementation
- Compose Hash: Fixed compose hash algorithm for Rust compatibility
UI/UX
- GPU TEE Dashboard: Updated GPU TEE dashboard page with new navigation
- Step Guide: Step-by-step guide in launch page
- Deposit Button: Added deposit button in launch view with amount selection
- Auto-fill Username: Automatically fill username after registration
Features
- Coinbase Terms: Accept terms before deposit with Coinbase
- Version Check: Check selected base image version before launch
- MCP Server Schema: Added logo and provider to MCPServer schema
Bug Fixes
- Added disk size validation checks
- Updated documentation and privacy policy links
- Improved GPU TEE dashboard layout spacing
Features
- Transaction History: View complete transaction history for account
- SEO: Setup sitemap and robots.txt
- LLMs.txt: Added markdown as llms.txt for AI crawlers
- Eliza Patched: Use patched Eliza version, removed original 1.x images
Admin Tools
- User Transactions: Admin panel for user transaction list
- Instance Events: Added instance events to admin interface
- Credit Indexing: Added indexing for credit_transactions for performance
UI/UX
- MCP Landing: New MCP-hosting landing page
- Navigation: Added “About” to main navigation
Admin Tools
- CVM Admin: Complete admin CVM list with pagination
- User Info: Enhanced UserInfo component for admin view
- Verified Filter: Added verified status filter for admin user list
- Billing Summary: Billing summary in user overview
Features
- Usage Limits: Account-level usage limits for free tier
- Privacy & Terms: Added privacy policy and terms of service
- CalCom Integration: Contact form with CalCom scheduling
Infrastructure
- Sentry: Added Sentry for error capture
- SQLAlchemy Utils: Added sqlalchemy-utils dependency
Architecture Changes
- Team Billing: Shifted from tier-based to CVM billing_period based charges
- Dedicated Nodes: Added dedicated_for_team_id to teepods for team reservations
- Team Slugs: Generate slug when creating teams
- Billing Rates: Set billing price and compute unit at launch and resize
API Changes
- Tier Compatibility: Removed tier from business logic, kept API compatible
- Stripe Setup: API for account verification with Stripe Setup Intent
Infrastructure
- Python Slugify: Added python-slugify dependency
- Money Type: Direct comparison with int/float for Money type
UI/UX
- Log Viewer: New log viewer component
- Debt Settlement: Complete debt-settlement page and API
- Verification Form: New VerificationForm component
- MDX Plugin: Setup MDX plugin with policy and terms pages
- Submenu: New submenu structure for usage and AI pages
Features
- Free Quota: Logic for free instance quota management
- RedPill Atom: Added isRedpillEnabledAtom for feature control
- Pricing Calculator: Compute resource pricing calculator
Bug Fixes
- Fixed attestation explorer functionality
- Resolved scroll transition issues after build
- Fixed sidebar default state
Features
- Notifications: New notification system with overdue alerts
- Payment History: Complete payment order history
- Feature Flags: Feature flags atom for client integration
- Money Type: Using Money type in charging logic with granted_balance handling
API Development
- Feature Flags API: Server-side feature flags API
- Granted Credits: Returns granted-credits in /me API
UI/UX
- Launch Page: Use launch page by default
- Attestation Guide: Improved RTMR3 reproduce documentation
Payment Integration
- Coinbase Commerce: Complete Coinbase charge and top-up API workflow
- Square API: Square API integration (testing phase)
- Orders Table: Added orders table, removed billing_items
- HashedId: New HashedId type for secure identifiers
Infrastructure
- Money Type: Added Money type for financial calculations
- CI Feedback: Added feedback to PR if CI fails
- Staging Environment: Added staging environment configuration
Billing System
- Credit Billing: Complete billing from credits system
- Overdue Handling: Create overdue transactions and shutdown CVMs when due
- Team Transactions: Added team_id and has_paid to CreditTransaction
- Billing Navigation: New billing navigation structure
UI/UX
- Billing Page: New billing page with transaction history
- Container Query: Using container-query for responsive design
- Registry Form: Private container registry form
- Pre-launch Script: Built-in pre-launch script attached by default
Team Features
- Team Tiers: Added team tier (free, pro, enterprise) with trial periods
- Capacity Limits: Enable capacity limits for free tier users
- Usage Logs: Enable usage and instance event logs for all users
Admin Tools
- Tier Update: Team tier update form and API
- User Filters: Support filters in admin user list
- Event Tracking: Events display in admin CVM view
UI/UX
- Billing Details: Details item table for billing records
- Resource API: Use new resource API in compute panel
- Eliza Input: CommaSeparatedInput for Twitter config
Eliza Features
- Eliza Versions: Support for setting and updating Eliza versions
- Local Storage: Save Eliza environment variables in local storage
- Config Form: Eliza configuration edit form with all settings
- Project API: New API for project list and details
Security
- Rate Limiting: IP + UA + language header based registration rate limiting
- Gmail Protection: Prevent multiple registrations with same Gmail using + trick
UI/UX
- Landing Page: LLM-generated landing page
- Pricing Page: LLM-generated pricing page with copy
- Billing UI: Complete billing page components and layout
Bug Fixes
- Fixed docker-compose generation issues
- Updated Eliza characters repository location
- Resolved dev image detection problems
- Fixed docker-compose depends_on dictionary format
Improvements
- Allow HTTP endpoints in Teepod connect form
- Check image existence before CVM creation
- Added ensure_cvm_stopped utility function
- Set Twitter 2FA secret as required field
Eliza Hosting
- Character Loader: Remote characterfile loader
- Provision API: API to provision CVM for Eliza
- Eliza Apps Table: hosted_eliza_apps table for tracking
- Web UI: Complete web UI integration for Eliza provisioning
Team System
- Teams Table: New teams table with relationships
- Revisions: Create revision tracking on CVM create and update
- Auto Team: Automatically create team when creating user
Security
- E2E Encryption: Secrets E2E encrypted, not stored in characterfile
- Same-Site Only: Only allow return to same-site on login/register
Eliza Builder
- Multi-Step Form: Complete multi-step form for Eliza characterfile editing
- Client Config: Configuration input for all known Eliza clients
- Environment Input: Enhanced environment variable input components
- Model Config: Model provider configuration options
Features
- Usage Check: User usage and role checks for available Teepod allocation
- Image Parsing: Parse list_images response from Teepod RPC
- Stats API: Standalone authorization token for stats API
CVM Management
- Ownership Transfer: Transfer CVM ownership between users
- Public State: Change public state from CVM settings
- Graceful Shutdown: Implemented graceful shutdown before upgrades
- Graceful Restart: Restart CVM with graceful shutdown
Bug Fixes
- Fixed validation rules for Docker Compose restart field
- Resolved credits calculation and CVM counts
- Fixed compose manifest panel display issues
Features
- Promotion Codes: Use promotion codes as invite codes
- MailerLite: Save mailerlite_user_id for marketing
- User Management: Added disabled flag and email field to users table
Bug Fixes
- Fixed API key authentication issues
- Resolved CVM attestation retrieval problems
- Fixed Teepod admin list filters
- Improved status and progress detection
Improvements
- Auto-refetch CVM info on mount
- Hide port 443 in public endpoints for cleaner URLs
- Unified cookie management
Bug Fixes
- Fixed docker_config schema validation
- Resolved docker-compose.yml user existence checks
Features
- Status Checking: Scheduled task to check Teepod status
- App-Compose V2: Adjusted for app-compose v2 schema
- Metadata Sync: sync_teepod_metadata and ping API
UI/UX
- Reversed Order: Show CVMs in reversed order (most recent first)
- Creating Status: More accurate creating status display
- Search: Enhanced search functionality
Features
- CVM Upgrade: Minimal implementation for CVM upgrades
- Upgrade Registry: Simple upgrade registry system
- Redis Job Store: Setup Redis as job store for scheduling
- URL Arguments: Support URL argument identifiers
UI/UX
- Compose Editor: Improved compose edit form
- Health Check: Enhanced CVM health checking
- Error Handling: Better error handling for ofetch and QueryClient
Infrastructure
- Various backend optimizations and improvements
- Code refactoring and cleanup
- Performance enhancements
Features
- VM Status: Added “starting” status for better state tracking
- Pod Lifecycle: Wait for pod alive after creation
- API Tokens: Token list, generate, and revoke functionality
Admin Tools
- Admin Panel: Comprehensive admin for users, credits, and promotion codes
UI/UX
- Consistent Flow: Built consistent request flow for different CVM create workflows
- VM List UI: New UI for VM list presentation
API Development
- K8s-like API: Kubernetes-like spec-based pod create API