Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.phala.com/llms.txt

Use this file to discover all available pages before exploring further.

This feature works for both API Access and Dedicated Models.

​
Structured Output in Confidential AI

Confidential AI supports structured output, enabling you to receive responses in specific formats such as JSON structures. This is particularly useful for applications that require data to be processed or integrated into other systems.

​
Example of Structured Output

Replace <API_KEY> with your actual API key in the examples below. 
import requests

response = requests.post(
    "https://api.redpill.ai/v1/chat/completions",
    headers={
        "Authorization": "Bearer <API_KEY>",
        "Content-Type": "application/json",
    },
    json={
        "model": "phala/deepseek-chat-v3-0324",
        "messages": [
            {"role": "user", "content": "What is the weather like in Los Angeles?"},
        ],
        "response_format": {
            "type": "json_schema",
            "json_schema": {
                "name": "weather",
                "strict": True,
                "schema": {
                    "type": "object",
                    "properties": {
                        "location": {
                            "type": "string",
                            "description": "City or location name",
                        },
                        "temperature": {
                            "type": "number",
                            "description": "Temperature in Celsius",
                        },
                        "conditions": {
                            "type": "string",
                            "description": "Weather conditions description",
                        },
                    },
                    "required": ["location", "temperature", "conditions"],
                    "additionalProperties": False,
                },
            },
        },
    },
)

data = response.json()
info = data["choices"][0]["message"]["content"]
print(info)

{
   "location":"Los Angeles",
   "temperature":75,
   "conditions":"Sunny with a few clouds"
}

​
Supported Models for Structured Output

Confidential AI supports structured output for the following models:
  • phala/deepseek-chat-v3-0324
  • phala/gemma-3-27b-it
  • phala/gpt-oss-20b
  • phala/gpt-oss-120b
  • phala/qwen2.5-vl-72b-instruct