AI-as-a-Service: Architecting GenAI Application Governance with Azure API Management and Fabric

The past year has seen explosive growth for Azure OpenAI and large language models in general. With models reliant on a token-based approach for processing requests, ensuring prompt engineering is being done correctly, tracking what models and api‘s are being used, load balancing across multiple instances, and creating chargeback models has become increasingly important. The […]

AI-as-a-Service: Architecting GenAI Application Governance with Azure API Management and Fabric Continue Reading