OpenAI has launched the Utilization API, an API that enables enterprises to trace their exercise throughout the OpenAI API. With the Utilization API, OpenAI API utilization and prices could be assessed programmatically, the corporate mentioned.
Introduced December 4, the OpenAI Utilization API screens token utilization by minute, hour, or day and filters utilization knowledge by components resembling mannequin, API key, mission ID, and person ID. Customers can examine every day spending through a prices endpoint for finances oversight. The Utilization API, OpenAI mentioned, is constructed for scalability, safety, and compliance, for enterprise groups to handle prices, optimize workflows, and make faster choices.
Whereas the Utilization API delivers granular utilization knowledge, it might not at all times reconcile completely with prices attributable to minor variations in how utilization and spend are recorded, OpenAI mentioned. For monetary functions, OpenAI recommends utilizing the Prices endpoint or the Prices tab within the Utilization Dashboard, which is able to reconcile again to a billing bill.