UNPKG

paitient-secure-model

Version:

PaiTIENT - HIPAA/SOC2 compliant secure model hosting SDK

132 lines (96 loc) 3.87 kB
# Secure Model Service A HIPAA/SOC2 compliant service for deploying private encrypted AI models to individual clients. This enterprise-grade solution allows secure deployment and management of LLMs with state-of-the-art encryption, monitoring, and subscription management. ![License](https://img.shields.io/badge/license-MIT-blue.svg) ![Python](https://img.shields.io/badge/python-3.8%20%7C%203.9%20%7C%203.10%20%7C%203.11-blue) ![npm](https://img.shields.io/badge/npm-v14%2B-blue) ## Architecture Overview This service provides on-demand deployment of secure, isolated AI model endpoints for clients. The system: 1. Creates encrypted copies of AI models using hybrid encryption (AES-256-GCM + RSA-4096) 2. Provisions isolated compute resources via Kubernetes or AWS EC2 3. Establishes secure endpoints accessible only to authorized clients with valid subscriptions 4. Enables inference, fine-tuning, and secure model management 5. Manages the complete lifecycle of model deployment with continuous monitoring ## Installation ### Python Package ```bash pip install secure-model-service ``` ### Node.js Package ```bash npm install secure-model-sdk ``` ## Quick Start ### Python ```python from secure_model_service import SecureModelClient # Initialize client client = SecureModelClient( api_key="your-api-key", client_id="your-client-id" ) # Deploy a model deployment = client.deploy( model_name="ZimaBlueAI/HuatuoGPT-o1-8B", tier="pro", use_gpu=True ) # Generate text response = client.generate( prompt="Explain how your encryption system ensures HIPAA compliance:", max_tokens=100 ) print(response.text) ``` ### Node.js ```javascript const { SecureModelClient } = require('secure-model-sdk'); // Initialize client const client = new SecureModelClient({ apiKey: 'your-api-key', clientId: 'your-client-id' }); // Deploy a model async function deployModel() { const deployment = await client.deploy({ modelName: 'ZimaBlueAI/HuatuoGPT-o1-8B', tier: 'pro', useGpu: true }); console.log(`Deployment ID: ${deployment.deploymentId}`); // Generate text const response = await client.generate({ prompt: 'Explain how your encryption system ensures HIPAA compliance:', maxTokens: 100 }); console.log(response.text); } deployModel(); ``` ### Command Line ```bash # Python CLI secure-model deploy --model ZimaBlueAI/HuatuoGPT-o1-8B --tier pro --use-gpu # Node.js CLI secure-model deploy --model ZimaBlueAI/HuatuoGPT-o1-8B --tier pro --use-gpu ``` ## Key Components - **Encryption Service**: Hybrid AES-256-GCM + RSA-4096 encryption for model weights - **Kubernetes Orchestration**: Dynamic scaling of compute resources with auto-scaling - **AWS Integration**: S3 for secure storage, EC2 for compute, IAM for access control - **API Gateway**: Client-facing interfaces with subscription validation - **Authentication & Authorization**: Multi-layered security with API keys and subscription validation - **Monitoring & Logging**: HIPAA/SOC2 compliant audit logging and Prometheus metrics ## Security Compliance - HIPAA compliant data handling with audit logging - SOC2 compliant operational procedures and monitoring - End-to-end encryption of model artifacts and inference data - Isolated per-client compute resources with secure networking - Continuous subscription validation and automated lockout ## Documentation For complete documentation, visit our [Documentation Site](https://yourdomain.com/docs). - [API Reference](https://yourdomain.com/docs/api) - [Python SDK Guide](https://yourdomain.com/docs/python-sdk) - [Node.js SDK Guide](https://yourdomain.com/docs/node-sdk) - [Architecture Details](https://yourdomain.com/docs/architecture) - [Security Specifications](https://yourdomain.com/docs/security) - [Deployment Options](https://yourdomain.com/docs/deployment)