Postgres FM19 Elo 2022

Monitoring checklist

Monitoring checklist (dashboard 1):

TPS and (optional but also desired) QPS
Latency (query duration) — at least average. Better: histogram, percentiles
Connections (sessions) — stacked graph of session counts by state (first of all: active and idle-in-transaction; also interesting: idle, others) and how far the sum is from max_connection (+pool size for PgBouncer).
Longest transactions (max transaction age or top-n transactions by age), excluding autovacuum activity
Commits vs rollbacks — how many transactions are rolled back
Transactions left till transaction ID wraparound
Replication lags / bytes in replication slot / unused replication slots
Count of WALs waiting to be archived (archiving lag)
WAL generation rates
Locks and deadlocks
Basic query analysis graph (top-n by total_time or by mean_time?)
Basic wait event analysis (a.k.a. “active session analysis” or “performance insights”)

And links to a few things we mentioned:

Postgres monitoring review checklist (community document)
pgstats.dev
Improving Postgres Connection Scalability: Snapshots (blog post by Andres Freund)
Transaction ID Wraparound in Postgres (blog post by David Cramer)
Subtransactions Considered Harmful (blog post by Nikolay)
datadoghq.com
pgwatch2 (Postgres.ai Edition)

------------------------

What did you like or not like? What should we discuss next time? Let us know by tweeting us on @samokhvalov and @michristofides

If you would like to share this episode, here's a good link (and thank you!)

Postgres FM is brought to you by:

Nikolay Samokhvalov, founder of Postgres.ai
Michael Christofides, founder of pgMustard

With special thanks to:

Jessie Draws for the elephant artwork

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(188)

Estimating work_mem

Nik and Michael are joined by Shaun Thomas to discuss estimating work_mem, memory management in general, and writing an extension to help. Here are some links to things they mentioned: Shaun Thomas ht...

21 Elo 50min

pgrust

Nik and Michael are joined by Michael Malis, co-creator of pgrust, to discuss their Postgres rewrite, including reliability problems, compatibility testing, faster analytics, and a new JIT-compiled qu...

14 Elo 35min

MVCC

Nik and Michael are joined by Radim Marek to discuss MVCC, including his recent article on how Postgres chose to implement it compared to other systems. Here are some links to things they mentioned: R...

7 Elo 44min

Xata

Nik and Michael are joined by Tudor Golubenco, CTO of Xata, to discuss their architecture, progress, and open source tooling. Here are some links to things they mentioned: Tudor Golubenco https://post...

31 Heinä 46min

DBOS

Nik and Michael are joined by Qian Li and Peter Kraft to talk about DBOS, an open source platform for durable workflows built on Postgres. Here are some links to things they mentioned: Qian Li https:...

24 Heinä 39min

pg_stat_log

Nik and Michael are joined by Fabrízio Mello to discuss his new extension pg_stat_log.Here are some links to things they mentioned: Fabrízio Mello https://postgres.fm/people/fabrizio-de-royes-melloTim...

17 Heinä 44min

pgBackRest

Nik and Michael are joined by David Steele to talk all things pgBackRest. Here are some links to things they mentioned: David Steele https://postgres.fm/people/david-steelepgBackRest https://pgbackres...

3 Heinä 1h 13min

autovacuum

Nik and Michael discuss autovacuum, including what it does, and the basics of why and how to tune it. Here are some links to things they mentioned: autovacuum https://www.postgresql.org/docs/current/...

29 Touko 46min