In this episode of Scaling Postgres, we discuss how to optimize your database for analytics, how to speed up counts, improvements to TimescaleDB and why you should stop using serial. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/334-optimizing-for-analytics/ Want to learn more about P…

In this episode of Scaling Postgres, we discuss when select can write, Postgres RC1 is released, Tetris in SQL and copy, swap, drop. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/333-when-select-writes/ Want to learn more about Postgres performance? Join my FREE training called Postgr…

In this episode of Scaling Postgres, we discuss what can happen when queries get slow, backup best practices, Postgres emergencies and the state of Postgres survey. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/332-sometimes-it-is-slow/ Want to learn more about Postgres performance? J…

In this episode of Scaling Postgres, we discuss whether pg_dump is a backup tool, the pgMonitor extension, Postgres malware, and application uses for the merge command. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/331-is-pg_dump-a-backup-tool/ Want to learn more about Postgres perfor…

In this episode of Scaling Postgres, we discuss the merging of Postgres and DuckDB via the pg_duckdb extension, how this can help the analytics story for Postgres, some ways to improve PG analytics and building a search engine. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/330-splicin…

In this episode of Scaling Postgres, we discuss PGlite, an embeddable Postgres, postgres.new which adds AI features, new Postgres releases and the performance of synchronous replication. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/329-pglite-embeddable-postgres/ Want to learn more a…

In this episode of Scaling Postgres, we discuss different get or create implementations, a new pgBouncer version, alter default privileges, and six degrees of separation with Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/328-implement-get-or-create/ Want to learn more about …

In this episode of Scaling Postgres, we discuss using Postgres for graph queries, the fastest way to copy data from one table to another, dealing with linux memory overcommit and compression. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/327-postgres-graph-queries/ Want to learn more …

In this episode of Scaling Postgres, we talk about speeding up index creation, extensions to track wait events, a row pattern recognition feature and savepoints. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/326-faster-index-creation/ Want to learn more about Postgres performance? Joi…

In this episode of Scaling Postgres, we discuss more ways to keep the superior performance of keyset pagination, how to implement UUIDv7 in SQL functions, how expensive extended statistics are and the benefits of range columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/325-faster-…

In this episode of Scaling Postgres, we discuss experiments to achieve four million transaction per second, the importance of extended statistics, parallelism in Postgres and an introduction to window functions. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/324-four-million-tps/ Want …

In this episode of Scaling Postgres, we discuss a breaking change in the new version of PgBouncer, PostgreSQL 17 Beta 2 is released, examination of the new built-in collation provider in PG 17 and Notion's data lake. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/323-pgbouncer-breaking…

In this episode of Scaling Postgres, we discuss an incremental sort instability issue with the Postgres planner, whether we should use foreign keys, how the visibility map works and how to vacuum the template0 database. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/322-postgres-sort-i…

In this episode of Scaling Postgres, we discuss the shutdown of Ottertune, how schema changes cause locks and how to avoid them, the benefits of on conflic do nothing, and pgvectorscale. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/321-ottertune-is-dead/ Want to learn more about Post…

In this episode of Scaling Postgres, we discuss three organizations scaling their databases to 100 TB and beyond, collation speed, configuring memory and new AI extensions To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/320-100tb-and-beyond/ Want to learn more about Postgres performance…

In this episode of Scaling Postgres, we discuss a time when Postgres development stopped, two new extensions pg_lakehouse & pg_compare and the upcoming event Posette. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/319-when-postgres-development-stoppped/…

In this episode of Scaling Postgres, we discuss all the new features in Postgres 17 Beta 1, some features that did not make it, database collations & sorting and causes of slow commits. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/318-postgres-17-beta-1-released/…

In this episode of Scaling Postgres, we discuss a new time-series open source extension called pg_timeseries, Postgres ignoring indexes, JSONB selectivity issues, and geographically distributed multi-tenant applications. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/317-time-series-op…

In this episode of Scaling Postgres, we discuss new Postgres releases, optimizing a query to be 1,000 times faster, custom vs. generic plans and the pgtt extension. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/316-new-releases-1000-times-faster-query/…

In this episode of Scaling Postgres, we discuss how hacking on Postgres is hard, a notifier pattern for using Listen/Notify, using histograms for metrics and saturated arithmetic. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/315-hacking-on-postgres-is-hard/…

In this episode of Scaling Postgres, we discuss performance improvements for pgvector 0.7.0, a guide to vector embeddings, building a Retrieval Augmented Generation app and only allow logins to replicas. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/314-150-times-faster-pgvector/…

In this episode of Scaling Postgres, we discuss whether the future of MySQL is Postgres, how to use recursive CTEs, work on OrioleDB, and PG17 performance improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/313-the-future-of-mysql-is-postgres/…

In this episode of Scaling Postgres, we cover potential features in Postgres 17 such as explain serialize, verbose copy, pg_buffer_cache_evict, as well as many others. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/312-postgres-17-commit-orama/…

In this episode of Scaling Postgres, we discuss a 1,400 times faster max and group by implementation, new quantization capabilities in pgvector, adaptive radix trees and splitting & merging partitions in PG17. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/311-max-group-by-performance/…

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/310-andres-microsoft-postgres-save-linux/…

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/309-will-postgres-pull-a-redis/…

In this episode of Scaling Postgres, we discuss high availability's future, a custom sharding solution by Figma, sharding pg_vector queries, and PG17 logical replication failover. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/308-scale-through-sharding/…

In this episode of Scaling Postgres, we discuss whether we should be using bytewise or linguistic ordering by default, how to transform data in Postgres, benefits of a transaction_timeout and how to enforce join order. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/307-collation-conund…

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/306-scalability-limits-fro…

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/305-11k-faster-configurati…

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/304-overhead-of-pg_stat_statements/…

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/303-pgbouncer-pgcat-supavisor-fight/…

In this episode of Scaling Postgres, we discuss when and how you should use UUIDs or not, how to optimize space with column order and arrays, whether it is better to tune parameters or queries and what devs should know about Postgres with Andrew Atkinson. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostg…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/301-postgres-llm-os-30-times-fas…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/300-postgres-celebration/…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/299-build-a-gpt-in-sql/…

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/298-10-100-times-higher-latency-with-distributed-postgres/…

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/297-postgres-in-2024/By Creston Jamison

In this episode of Scaling Postgres, we discuss the State of Postgres 2023 survey, a repository of Postgres how-tos, ways foreign keys can break and a custom SQL playground. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/296-state-of-postgres-2023/…

In this episode of Scaling Postgres, we discuss a 30K messages per second queue built on Postgres, a zero downtime logical replication upgrade, the release of the Supavisor 1.0 connection pooler and PostGIS day. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/295-30k-messages-per-second…

In this episode of Scaling Postgres, we discuss how much observability is needed, avoiding locks during database migrations, a huge Postgres events blogging event and FIPS mode. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/294-how-much-observability-is-needed/…

In this episode of Scaling Postgres, we discuss how create statistics can help you get better plans, issues with subtransactions, all about extensions and best practices when indexing timestamps. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/293-better-plans-with-statistics/…

In this episode of Scaling Postgres, we discuss using companion databases, multi-tenancy database design, whether SQL is good, and different transaction isolation levels. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/292-companion-databases/…

In this episode of Scaling Postgres, we discuss Timescale's performance improvements from adding a query vectorization pipeline, doing blue-green deployments for databases, using reserved_connections and two improvements to null handling. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/…

In this episode of Scaling Postgres, we discuss my Postgres Performance Starter Kit, new releases of Postgres, removing JIT, and a lightweight message queue. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/290-postgres-releases-equals-reindexing/…

In this episode of Scaling Postgres, we discuss new options for Postgres scheduling tools, proper ways to kill processes and explain usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/289-postgres-scheduling-opportunities/By Creston Jamison

In this episode of Scaling Postgres, we discuss index corruption from a ICU collation change, another caveat for PgBouncer prepared statements, ways to version data, and using Postgres as a cache. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/288-index-corruption-from-icu-collation-ch…

In this episode of Scaling Postgres, we discuss how the new version of pgbouncer could get you 15% to 250% faster query throughput, the availability of using kubernetes snapshots for backup and restore with CloudNativePg and Ruby on Rails Postgres improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalin…

In this episode of Scaling Postgres, we discuss a new extension that promises substantially faster text search and ranking, an AI content storm, how to work with money and the fastest way to stop Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/286-20-times-faster-text-search-r…

In this episode of Scaling Postgres, we cover a deep dive into indexes from a presentation that includes a decision tree of sorts, how to convert to partitioned tables once you have hundreds of millions of rows and detail about the new pg_stat_io view. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres…