Scaling Postgres to the next level at OpenAI

PostgreSQL serves as a cornerstone of OpenAI's backend infrastructure, powering many of our most critical features. In this talk, I will share how we've taken PostgreSQL to the next level to handle OpenAI's demanding workloads on Azure. I'll cover the challenges we faced, the lessons learned from outages, and the strategies we implemented to scale Azure Database for PostgreSQL to handle millions of queries per second (QPS). Key topics include:

• Connection Pooling: How we effectively manage connection pooling with PgBouncer.
• Read Replication: Strategies for scaling read replicas to meet increasing demand.
• Schema Migrations and Long-Running Queries: Approaches to seamless schema migrations and resolving performance bottlenecks caused by long-running queries.
• Observability: Enhancing monitoring and observability to ensure reliability and performance.