Using the API directly is not recommended for most users. Instead, we recommend using the Python SDK.
Request Body
The job_id returned when you submitted the batch inference job
Whether to include the inputs in the results
Whether to include the cumulative logprobs in the results
Headers
Your Sutro API key using Key authentication scheme.Format:
Key YOUR_API_KEY
Example: Authorization: Key sk_live_abc123...
Response
Returns the results of the batch inference job.If
include_inputs
is True
, the results will be a dictionary with inputs
and outputs
keys. If include_inputs
is False
, the results will be a dictionary with outputs
key. Results are in the same order as the inputs.Verbose message for the job’s results
Code Examples
Notes
- Results can only be retrieved for jobs that have completed successfully
- The order of results matches the order of the original inputs
- Including cumulative logprobs provides additional statistical information about the model’s confidence in its outputs