In this episode of Scaling Postgres, we discuss using Postgres for graph queries, the fastest way to copy data from one table to another, dealing with linux memory overcommit and compression. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/327-postgres-graph-queries/ Want to learn more …

In this episode of Scaling Postgres, we talk about speeding up index creation, extensions to track wait events, a row pattern recognition feature and savepoints. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/326-faster-index-creation/ Want to learn more about Postgres performance? Joi…

In this episode of Scaling Postgres, we discuss more ways to keep the superior performance of keyset pagination, how to implement UUIDv7 in SQL functions, how expensive extended statistics are and the benefits of range columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/325-faster-…

In this episode of Scaling Postgres, we discuss experiments to achieve four million transaction per second, the importance of extended statistics, parallelism in Postgres and an introduction to window functions. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/324-four-million-tps/ Want …

In this episode of Scaling Postgres, we discuss a breaking change in the new version of PgBouncer, PostgreSQL 17 Beta 2 is released, examination of the new built-in collation provider in PG 17 and Notion's data lake. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/323-pgbouncer-breaking…

In this episode of Scaling Postgres, we discuss an incremental sort instability issue with the Postgres planner, whether we should use foreign keys, how the visibility map works and how to vacuum the template0 database. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/322-postgres-sort-i…

In this episode of Scaling Postgres, we discuss the shutdown of Ottertune, how schema changes cause locks and how to avoid them, the benefits of on conflic do nothing, and pgvectorscale. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/321-ottertune-is-dead/ Want to learn more about Post…

In this episode of Scaling Postgres, we discuss three organizations scaling their databases to 100 TB and beyond, collation speed, configuring memory and new AI extensions To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/320-100tb-and-beyond/ Want to learn more about Postgres performance…

In this episode of Scaling Postgres, we discuss a time when Postgres development stopped, two new extensions pg_lakehouse & pg_compare and the upcoming event Posette. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/319-when-postgres-development-stoppped/…

In this episode of Scaling Postgres, we discuss all the new features in Postgres 17 Beta 1, some features that did not make it, database collations & sorting and causes of slow commits. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/318-postgres-17-beta-1-released/…

In this episode of Scaling Postgres, we discuss a new time-series open source extension called pg_timeseries, Postgres ignoring indexes, JSONB selectivity issues, and geographically distributed multi-tenant applications. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/317-time-series-op…

In this episode of Scaling Postgres, we discuss new Postgres releases, optimizing a query to be 1,000 times faster, custom vs. generic plans and the pgtt extension. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/316-new-releases-1000-times-faster-query/…

In this episode of Scaling Postgres, we discuss how hacking on Postgres is hard, a notifier pattern for using Listen/Notify, using histograms for metrics and saturated arithmetic. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/315-hacking-on-postgres-is-hard/…

In this episode of Scaling Postgres, we discuss performance improvements for pgvector 0.7.0, a guide to vector embeddings, building a Retrieval Augmented Generation app and only allow logins to replicas. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/314-150-times-faster-pgvector/…

In this episode of Scaling Postgres, we discuss whether the future of MySQL is Postgres, how to use recursive CTEs, work on OrioleDB, and PG17 performance improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/313-the-future-of-mysql-is-postgres/…

In this episode of Scaling Postgres, we cover potential features in Postgres 17 such as explain serialize, verbose copy, pg_buffer_cache_evict, as well as many others. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/312-postgres-17-commit-orama/…

In this episode of Scaling Postgres, we discuss a 1,400 times faster max and group by implementation, new quantization capabilities in pgvector, adaptive radix trees and splitting & merging partitions in PG17. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/311-max-group-by-performance/…

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/310-andres-microsoft-postgres-save-linux/…

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/309-will-postgres-pull-a-redis/…

In this episode of Scaling Postgres, we discuss high availability's future, a custom sharding solution by Figma, sharding pg_vector queries, and PG17 logical replication failover. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/308-scale-through-sharding/…

In this episode of Scaling Postgres, we discuss whether we should be using bytewise or linguistic ordering by default, how to transform data in Postgres, benefits of a transaction_timeout and how to enforce join order. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/307-collation-conund…

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/306-scalability-limits-fro…

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/305-11k-faster-configurati…

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/304-overhead-of-pg_stat_statements/…

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/303-pgbouncer-pgcat-supavisor-fight/…

In this episode of Scaling Postgres, we discuss when and how you should use UUIDs or not, how to optimize space with column order and arrays, whether it is better to tune parameters or queries and what devs should know about Postgres with Andrew Atkinson. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostg…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/301-postgres-llm-os-30-times-fas…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/300-postgres-celebration/…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/299-build-a-gpt-in-sql/…

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/298-10-100-times-higher-latency-with-distributed-postgres/…

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/297-postgres-in-2024/By Creston Jamison

In this episode of Scaling Postgres, we discuss the State of Postgres 2023 survey, a repository of Postgres how-tos, ways foreign keys can break and a custom SQL playground. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/296-state-of-postgres-2023/…

In this episode of Scaling Postgres, we discuss a 30K messages per second queue built on Postgres, a zero downtime logical replication upgrade, the release of the Supavisor 1.0 connection pooler and PostGIS day. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/295-30k-messages-per-second…

In this episode of Scaling Postgres, we discuss how much observability is needed, avoiding locks during database migrations, a huge Postgres events blogging event and FIPS mode. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/294-how-much-observability-is-needed/…

In this episode of Scaling Postgres, we discuss how create statistics can help you get better plans, issues with subtransactions, all about extensions and best practices when indexing timestamps. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/293-better-plans-with-statistics/…

In this episode of Scaling Postgres, we discuss using companion databases, multi-tenancy database design, whether SQL is good, and different transaction isolation levels. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/292-companion-databases/…

In this episode of Scaling Postgres, we discuss Timescale's performance improvements from adding a query vectorization pipeline, doing blue-green deployments for databases, using reserved_connections and two improvements to null handling. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/…

In this episode of Scaling Postgres, we discuss my Postgres Performance Starter Kit, new releases of Postgres, removing JIT, and a lightweight message queue. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/290-postgres-releases-equals-reindexing/…

In this episode of Scaling Postgres, we discuss new options for Postgres scheduling tools, proper ways to kill processes and explain usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/289-postgres-scheduling-opportunities/By Creston Jamison

In this episode of Scaling Postgres, we discuss index corruption from a ICU collation change, another caveat for PgBouncer prepared statements, ways to version data, and using Postgres as a cache. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/288-index-corruption-from-icu-collation-ch…

In this episode of Scaling Postgres, we discuss how the new version of pgbouncer could get you 15% to 250% faster query throughput, the availability of using kubernetes snapshots for backup and restore with CloudNativePg and Ruby on Rails Postgres improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalin…

In this episode of Scaling Postgres, we discuss a new extension that promises substantially faster text search and ranking, an AI content storm, how to work with money and the fastest way to stop Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/286-20-times-faster-text-search-r…

In this episode of Scaling Postgres, we cover a deep dive into indexes from a presentation that includes a decision tree of sorts, how to convert to partitioned tables once you have hundreds of millions of rows and detail about the new pg_stat_io view. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres…

In this episode of Scaling Postgres, we discuss whether something is 23 times faster or 1.1 times faster. We also discuss the release of Timescale Vector and whether you can build a queue on Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/284-23-or-1-times-faster-performance/…

In this episode of Scaling Postgres, we discuss how to get 222 times faster analytical queries with columnar storage, a Postgres 16 feature review, the birth of a feature and fuzzy search. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/283-222-times-faster-analytical-queries-with-colum…

In this episode of Scaling Postgres, we discuss the release of Postgres 16, a Postgres meme, storing files or base64 strings and sharding intelligently. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/282-postgres-16-released-postgres-meme-file-vs-base64-strings-intelligent-sharding/…

In this episode of Scaling Postgres, we discuss the benefits and disadvantages of HNSW indexes for working with vector data, configuring vacuum to reduce bloat and optimize performance, the new options available for \watch and all about connections. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.co…

In this episode of Scaling Postgres, we discuss the release of Postgres 16 RC1, implementing bi-directional replication, different ways you can set up Postgres parameters and how to handle polymorphism and foreign keys. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/280-postgres-16-rc1…

In this episode of Scaling Postgres, we discuss how pgbouncer can impact a TPS benchmark, partition-wise join & aggregate performance, partitioning a table with billions of rows and cool Postgres 16 features. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/279-tps-benchmark-partition-wi…

In this episode of Scaling Postgres, we discuss how to squeeze the most out of your database, achieving one million connections to Postgres, how to use indexes with LIKE and pgvector HNSW index performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/278-squeeze-your-system-one-mill…