In this episode of Scaling Postgres, we discuss a 1,400 times faster max and group by implementation, new quantization capabilities in pgvector, adaptive radix trees and splitting & merging partitions in PG17. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/311-max-group-by-performance/…

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/310-andres-microsoft-postgres-save-linux/…

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/309-will-postgres-pull-a-redis/…

In this episode of Scaling Postgres, we discuss high availability's future, a custom sharding solution by Figma, sharding pg_vector queries, and PG17 logical replication failover. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/308-scale-through-sharding/…

In this episode of Scaling Postgres, we discuss whether we should be using bytewise or linguistic ordering by default, how to transform data in Postgres, benefits of a transaction_timeout and how to enforce join order. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/307-collation-conund…

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/306-scalability-limits-fro…

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/305-11k-faster-configurati…

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/304-overhead-of-pg_stat_statements/…

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/303-pgbouncer-pgcat-supavisor-fight/…

In this episode of Scaling Postgres, we discuss when and how you should use UUIDs or not, how to optimize space with column order and arrays, whether it is better to tune parameters or queries and what devs should know about Postgres with Andrew Atkinson. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostg…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/301-postgres-llm-os-30-times-fas…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/300-postgres-celebration/…

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/299-build-a-gpt-in-sql/…

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/298-10-100-times-higher-latency-with-distributed-postgres/…

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/297-postgres-in-2024/By Creston Jamison

In this episode of Scaling Postgres, we discuss the State of Postgres 2023 survey, a repository of Postgres how-tos, ways foreign keys can break and a custom SQL playground. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/296-state-of-postgres-2023/…

In this episode of Scaling Postgres, we discuss a 30K messages per second queue built on Postgres, a zero downtime logical replication upgrade, the release of the Supavisor 1.0 connection pooler and PostGIS day. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/295-30k-messages-per-second…

In this episode of Scaling Postgres, we discuss how much observability is needed, avoiding locks during database migrations, a huge Postgres events blogging event and FIPS mode. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/294-how-much-observability-is-needed/…

In this episode of Scaling Postgres, we discuss how create statistics can help you get better plans, issues with subtransactions, all about extensions and best practices when indexing timestamps. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/293-better-plans-with-statistics/…

In this episode of Scaling Postgres, we discuss using companion databases, multi-tenancy database design, whether SQL is good, and different transaction isolation levels. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/292-companion-databases/…

In this episode of Scaling Postgres, we discuss Timescale's performance improvements from adding a query vectorization pipeline, doing blue-green deployments for databases, using reserved_connections and two improvements to null handling. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/…

In this episode of Scaling Postgres, we discuss my Postgres Performance Starter Kit, new releases of Postgres, removing JIT, and a lightweight message queue. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/290-postgres-releases-equals-reindexing/…

In this episode of Scaling Postgres, we discuss new options for Postgres scheduling tools, proper ways to kill processes and explain usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/289-postgres-scheduling-opportunities/By Creston Jamison

In this episode of Scaling Postgres, we discuss index corruption from a ICU collation change, another caveat for PgBouncer prepared statements, ways to version data, and using Postgres as a cache. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/288-index-corruption-from-icu-collation-ch…

In this episode of Scaling Postgres, we discuss how the new version of pgbouncer could get you 15% to 250% faster query throughput, the availability of using kubernetes snapshots for backup and restore with CloudNativePg and Ruby on Rails Postgres improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalin…

In this episode of Scaling Postgres, we discuss a new extension that promises substantially faster text search and ranking, an AI content storm, how to work with money and the fastest way to stop Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/286-20-times-faster-text-search-r…

In this episode of Scaling Postgres, we cover a deep dive into indexes from a presentation that includes a decision tree of sorts, how to convert to partitioned tables once you have hundreds of millions of rows and detail about the new pg_stat_io view. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres…

In this episode of Scaling Postgres, we discuss whether something is 23 times faster or 1.1 times faster. We also discuss the release of Timescale Vector and whether you can build a queue on Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/284-23-or-1-times-faster-performance/…

In this episode of Scaling Postgres, we discuss how to get 222 times faster analytical queries with columnar storage, a Postgres 16 feature review, the birth of a feature and fuzzy search. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/283-222-times-faster-analytical-queries-with-colum…

In this episode of Scaling Postgres, we discuss the release of Postgres 16, a Postgres meme, storing files or base64 strings and sharding intelligently. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/282-postgres-16-released-postgres-meme-file-vs-base64-strings-intelligent-sharding/…

In this episode of Scaling Postgres, we discuss the benefits and disadvantages of HNSW indexes for working with vector data, configuring vacuum to reduce bloat and optimize performance, the new options available for \watch and all about connections. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.co…

In this episode of Scaling Postgres, we discuss the release of Postgres 16 RC1, implementing bi-directional replication, different ways you can set up Postgres parameters and how to handle polymorphism and foreign keys. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/280-postgres-16-rc1…

In this episode of Scaling Postgres, we discuss how pgbouncer can impact a TPS benchmark, partition-wise join & aggregate performance, partitioning a table with billions of rows and cool Postgres 16 features. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/279-tps-benchmark-partition-wi…

In this episode of Scaling Postgres, we discuss how to squeeze the most out of your database, achieving one million connections to Postgres, how to use indexes with LIKE and pgvector HNSW index performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/278-squeeze-your-system-one-mill…

In this episode of Scaling Postgres, we discuss new Postgres releases, taking the 2023 State of PostgreSQL survey, partitioning vs. sharding and the fastest way to do bulk loads. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/277-postgres-releases-postgresql-survey-partitioning-shardin…

In this episode of Scaling Postgres, we discuss the importance of correlation with BRIN indexes, how partitioning can kill performance, 10 tips for beginners and how to track table and index usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/276-brin-correlation-poor-partitioning-10…

In this episode of Scaling Postgres, we discuss getting rid of vacuum, how to do zero-downtime cut-overs, analyzing the impact of slow networks and seeing a not in optimization. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/275-no-more-vacuum-zero-downtime-cut-over-network-impact-not-…

In this episode of Scaling Postgres, we discuss subquery performance, how to avoid excessive locking when doing updates, how to change a columns datatype without excessive locking and lessons from an upgrade outage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/274-subquery-performanc…

In this episode of Scaling Postgres, we discuss how Debian & Ubuntu package Postgres, how ifflat indexes work, in vs any performance and how to log view usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/273-debian-ubuntu-packages-ivfflat-indexes-in-vs-any-view-logging/…

In this episode of Scaling Postgres, we discuss the release of Postgres 16 Beta 2, the rise of vectors and storing them, Foreign Data Wrapper performance and how to identify unused indexes. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/272-postgres-16-beta-2-rise-of-vectors-fdw-perfor…

In this episode of Scaling Postgres, we discuss how to get 30% faster performance, the downsides of UUIDs, having too much WAL and whether Postgres should use processes or threads. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/271-30-percent-faster-uuid-downsides-growing-wal-processes…

In this episode of Scaling Postgres, we discuss how to handle data skew, tools for Postgres monitoring, how to load data remotely and Postgres documentation. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/270-data-skew-monitoring-remote-access-csv-documentation/…

In this episode of Scaling Postgres, we discuss Postgres upgrade struggles, how and why to use hyperloglog, using pgbouncer for session vs. transaction pooling, and methods to scale Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/269-upgrade-struggles-hyperloglog-pgbouncer-usa…

In this episode of Scaling Postgres, we discuss faster COPY in Postgres 16, how to use psql variables, the importance of backup_label and issues with bad character encoding. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/268-faster-copy-psql-variables-backup_label-bad-encoding/…

In this episode of Scaling Postgres, we discuss the release of PostgreSQL 16 Beta 1, creating Rust functions with PL/Rust, memory problems related to partitioning and prepared statements, and modeling tags with arrays. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/267-postgres-16-beta…

In this episode of Scaling Postgres, we discuss new Postgres releases, EDB Postgres Distributed, a privilege template and real-time dashboards. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/266-postgres-releases-postgres-distributed-privilege-template-real-time-dashboard/…

In this episode of Scaling Postgres, we discuss different ways to use pg_stat_statements, how to handle transaction ID wraparound, consultant knowledge and all the videos of CitusCon. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/265-pg_stat_statements-transaction-id-wraparound-consul…

In this episode of Scaling Postgres, we discuss the worst part of Postgres, the status of pluggable storage, what makes a busy system and methods for managing different data architectures. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/264-worst-part-pluggable-storage-busy-system-data-…

In this episode of Scaling Postgres, we discuss LZ4 and ZSTD pg_dump compression, how to avoid problems, can triggers simplify and indexes can hurt. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/263-lz4-zstd-compression-avoiding-problems-triggers-simplify-indexes-can-hurt/…

In this episode of Scaling Postgres, we discuss the pg_failover_slots extension, how PG16 allows logical decoding on standbys, what are trusted language extensions and how a package manager has been built for them. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/262-pg_failover_slots-st…