totallyprivate.ai

What It Is

Totally Private AI Developer API is an isolated AI API built for regulated industries. It provides OpenAI-compatible REST endpoints deployed inside a TPAI private VPC that users access via VPN, with the backend invoking models through AWS Bedrock PrivateLink. The official site emphasizes that prompts do not traverse the public internet, and that the endpoints have no public DNS or public IP addresses.

Core Capabilities and Integrations

Its biggest advantage is “migration by simply changing the base URL”: existing tools such as OpenAI SDKs, curl, Cline, n8n, VS Code AI agent, and Open Notebook can theoretically connect as long as they support a custom base URL. It currently supports POST /v1/chat/completions, GET /v1/models, and GET /health. For models, the documentation explicitly lists Claude 3.5 Haiku and Claude 3.5 Sonnet, as well as other Claude-family models for which the account has Bedrock permissions. Tool calls and function calling are available, but depend on the capabilities of the underlying model.

Security, Privacy, and Limitations

The product positioning is very clear: it uses VPN-only access, internal load balancing, private IPs, per-user API keys encrypted in DynamoDB with customer-managed KMS keys, and CloudWatch/CloudTrail auditing to meet compliance teams’ requirements around network paths and access control. Compared with public LLM APIs, it reduces publicly reachable endpoints and third-party SaaS traffic paths. That said, the website also states plainly that embeddings, image generation, audio, and moderation are not currently available. Streaming accepts stream:true, but only returns a single SSE chunk, so it does not provide a true token-by-token experience.

Pricing and Who It’s For

Pricing is $199/month for the Pro subscription, which includes the chat interface and developer API. This is founding beta pricing, and the price is locked in for as long as the subscription remains active. The price is on the high side for individual developers, but more reasonable for enterprise teams handling contracts, internal knowledge, or compliance-sensitive data. It is especially well suited to teams that already have OpenAI-compatible applications but cannot allow prompts to travel over the public internet due to policy or customer requirements.

Access from China and Alternatives

The official site does not provide information about access from mainland China, payment methods, or localization support, so China accessibility can only be considered unknown. Using it from China would require practical testing of VPN access, DNS resolution, AWS Bedrock-related network paths, and payment availability. Alternatives include native AWS Bedrock PrivateLink, Azure OpenAI private networking solutions, OpenAI/Anthropic public APIs, or enterprise self-hosted open-source model gateways.