Skip to content

daedmonds/pg-collector

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

PG Collector

PostgreSQL Metrics Collector for Predictive Analytics

Release License Downloads

Install | Features | Tiers | Quick Start | Configuration | Security


Overview

PG Collector is a lightweight, high-performance PostgreSQL metrics collector designed for predictive database analytics. It runs as a single binary with zero external dependencies, collecting comprehensive database metrics and streaming them securely to the Burnside analytics platform.

Key Benefits:

  • Zero Impact - Designed to never affect database performance
  • Never Lose Data - Resilient buffering protects against network interruptions
  • Secure by Default - mTLS authentication, no passwords stored
  • Cloud Native - Works with RDS, Aurora, Cloud SQL, and self-managed PostgreSQL
  • Simple Setup - Configure your database connection, we handle the rest

Quick Install

One-Line Install (Linux/macOS)

curl -sSL https://raw.githubusercontent.com/burnside-project/pg-collector/main/scripts/install.sh | sudo bash

Specific Version

curl -sSL https://raw.githubusercontent.com/burnside-project/pg-collector/main/scripts/install.sh | sudo bash -s -- --version v1.0.0

Manual Download

Download the latest release from the Releases page.

Platform Architecture File
Linux x86_64 (amd64) pg-collector-linux-amd64.tar.gz
Linux ARM64 pg-collector-linux-arm64.tar.gz
macOS Intel (x86_64) pg-collector-darwin-amd64.tar.gz
macOS Apple Silicon pg-collector-darwin-arm64.tar.gz
Windows x86_64 pg-collector-windows-amd64.zip

Verify Download

Each release includes a checksums.txt file. After downloading:

sha256sum -c checksums.txt --ignore-missing

Subscription Tiers

PG Collector is available in three subscription tiers:

Feature Starter Pro Enterprise
Databases 1 Up to 10 Unlimited
Activity Monitoring 30s intervals 10s intervals Real-time (1s)
Statement Analytics Top 50 Top 500 Unlimited
Data Retention 7 days 30 days 90 days
Query Masking Basic Full Custom rules
Support Community Email Priority

Contact sales@burnsideproject.ai for pricing and enterprise features.


Features

Metrics Collected

Category Description Frequency
Activity Active sessions, wait events, query states Real-time
Performance Query statistics, I/O patterns, cache efficiency Periodic
Replication Lag, slot status, streaming state Real-time
Storage Table/index sizes, bloat indicators Periodic
Background Vacuum progress, checkpoint activity Periodic

Resource Guarantees

  • Memory: Configurable ceiling with automatic management
  • Disk: Local buffering during network interruptions
  • Connections: Minimal PostgreSQL connection usage (max 2)
  • Queries: Timeout protection prevents blocking

Authentication Methods

Method Use Case Documentation
mTLS (Certificate) Self-managed PostgreSQL (recommended) Security Guide
AWS IAM Amazon RDS, Aurora AWS Setup
GCP IAM Google Cloud SQL GCP Setup

Quick Configuration

You configure your database connection. Metrics delivery is handled automatically.

# Your credentials (provided during onboarding)
customer_id: "your_customer_id"
database_id: "your_database_id"

# Your PostgreSQL connection
postgres:
  conn_string: "postgres://pgcollector@your-db:5432/postgres?sslmode=verify-full"
  auth_method: cert
  tls:
    mode: verify-full
    ca_file: /etc/pg-collector/certs/ca.crt
    cert_file: /etc/pg-collector/certs/client.crt
    key_file: /etc/pg-collector/certs/client.key

See Configuration Guide for all options.


Running as a Service

Systemd (Linux)

sudo systemctl enable pg-collector
sudo systemctl start pg-collector
sudo systemctl status pg-collector

Docker

docker run -d \
  --name pg-collector \
  -v /etc/pg-collector:/etc/pg-collector:ro \
  ghcr.io/burnside-project/pg-collector:latest

Health & Monitoring

# Basic health check
curl http://localhost:8080/health

# Detailed status
curl http://localhost:8080/status

# Prometheus metrics
curl http://localhost:8080/metrics

How It Works

┌─────────────────┐     ┌─────────────────┐     ┌─────────────────┐
│  Your Database  │────▶│   PG Collector  │────▶│    Burnside     │
│   (PostgreSQL)  │     │   (Your Host)   │     │    Platform     │
└─────────────────┘     └─────────────────┘     └─────────────────┘
        │                       │                       │
    You manage            You configure          We manage
   the database          the connection        the analytics
  1. You configure the connection to your PostgreSQL database
  2. PG Collector securely collects metrics with minimal impact
  3. Burnside receives and analyzes the data for predictive insights

Documentation

Guide Description
Quick Start Get running in 5 minutes
Installation Detailed installation guide
Configuration All configuration options
Security mTLS setup, certificate management
AWS Setup RDS, Aurora deployment
GCP Setup Cloud SQL deployment
Monitoring Health checks, Prometheus metrics
CLI Reference Command-line options
Troubleshooting Common issues and solutions
FAQ Frequently asked questions

Support


License

Copyright 2024-2025 Burnside Project, Inc.

Licensed under the Apache License, Version 2.0 with Additional Terms. See LICENSE for the complete license text including warranty disclaimers and liability limitations.


Built for database reliability

About

pg-collector

Resources

Security policy

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages