Using the API directly is not recommended for most users. Instead, we recommend using the Python SDK.
Request Body
The job_id returned when you submitted the batch inference job
Whether to include the inputs in the results
Whether to include the cumulative logprobs in the results
Headers
Your Sutro API key using Key authentication scheme.Format:
Key YOUR_API_KEYExample: Authorization: Key sk_live_abc123...Response
Returns the results of the batch inference job.If
include_inputs is True, the results will be a dictionary with inputs and outputs keys. If include_inputs is False, the results will be a dictionary with outputs key. Results are in the same order as the inputs.Verbose message for the job’s results
Code Examples
Notes
- Results can only be retrieved for jobs that have completed successfully
- The order of results matches the order of the original inputs
- Including cumulative logprobs provides additional statistical information about the model’s confidence in its outputs