Benchmarking of fully-managed generative AI services/APIs

The aim of this report is to understand the current state of fully-managed AI services/APIs from the perspective of developers who use them to add generative AI functionality to their applications. We begin by examining which services/APIs developers are currently using. Following this, we take a close look at what attributes developers prioritise when evaluating fully-managed services/APIs for adding generative AI to their applications. Finally, we discuss how these services/APIs perform in terms of customer satisfaction (CSAT) for quality of outputs, ease of integration, reliability, and speed and latency amongst developers who use them.