Repositories list

• pfc-validator

  Public
  Standalone integrity checker for .pfc archives. Block-level verification, SHA-256 checksums, HTML reports.

  pythonclicompression+ 7

  pythonclicompressionsha256checksumspfcintegrity-checkerarchive-validationpfc-jsonlimpossibleforge

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated Jun 19, 2026Jun 19, 2026

• pfc-jsonl

  Public
  Cold storage that queries like hot storage. High-ratio JSONL compressor with block-level random access. Query cold storage in seconds — no restore, no full deco…

  clicompressions3+ 17

  clicompressions3data-compressionfluent-bitjsonlegresslog-compressionduckdbstorage-optimization+ 10

  Other

  •00 forks•55 stars•00 issues•00 pull requests•Updated Jun 19, 2026Jun 19, 2026

• pfc-landing

  Public
  Landing page for the PFC-JSONL Pipeline

  HTML

  •00 forks•00 stars•00 issues•00 pull requests•Updated Jun 6, 2026Jun 6, 2026

• pfc-export-elasticsearch

  Public
  Export Elasticsearch indices to PFC cold-storage archives

  pythoncliexport+ 7

  pythoncliexportelasticsearchcompressionpfccold-storagejsonlelastic-cloudlog-archiving

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 21, 2026May 21, 2026

• pfc-archiver-elasticsearch

  Public
  Autonomous cold-storage archive daemon for Elasticsearch

  pythonclielasticsearch+ 8

  pythonclielasticsearchcompressiondaemonarchiverpfccold-storagejsonlelastic-cloud+ 1

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 21, 2026May 21, 2026

• pfc-archiver-timescaledb

  Public
  Autonomous PFC cold-archive daemon for TimescaleDB — archive old hypertable data to .pfc files automatically

  pythoncompressiontimeseries+ 9

  pythoncompressiontimeseriesdaemonpostgresqls3archiverpsycopg2pfccold-storage+ 2

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-export-timescaledb

  Public
  One-shot CLI to export TimescaleDB hypertables to compressed, queryable .pfc archives

  pythoncliexport+ 9

  pythoncliexportcompressiontimeseriespostgresqlpsycopg2pfccold-storagejsonl+ 2

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-archiver-influxdb

  Public
  Autonomous PFC cold-storage daemon for InfluxDB 2.x

  compressioninfluxdbtime-series+ 7

  compressioninfluxdbtime-seriesarchivings3logspfccold-storagejsonlinfluxdb2

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-export-clickhouse

  Public
  One-shot CLI export from ClickHouse to PFC cold-storage archives

  pythoncliexport+ 5

  pythoncliexportcompressionclickhousepfccold-storagejsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-archiver-clickhouse

  Public
  Autonomous PFC cold-archive daemon for ClickHouse

  pythoncompressiondaemon+ 7

  pythoncompressiondaemonclickhousearchivings3logspfccold-storagejsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-grafana

  Public
  Grafana data source plugin for PFC-JSONL cold archives — query .pfc files directly from Grafana dashboards via pfc-gateway

  metricsgrafanalogs+ 7

  metricsgrafanalogsdatasourceobservabilitypfccold-storagegrafana-pluginduckdbpfc-jsonl

  TypeScript

  •

  Other

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-export-influxdb

  Public
  One-shot CLI export from InfluxDB 2.x to PFC cold-storage archives

  pythoncliflux+ 9

  pythonclifluxexportcompressioninfluxdbtime-seriespfccold-storagejsonl+ 2

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-vector

  Public
  High-performance PFC ingest daemon for Vector.dev, Telegraf and HTTP sources — Rust + Tokio

  rusthigh-performancevector+ 6

  rusthigh-performancevectorlogsingestpfccold-storagejsonlpfc-jsonl

  Rust

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-export-questdb

  Public
  Export QuestDB tables directly to PFC cold-storage archives with timestamp index

  exporttimeseriesarchive+ 5

  exporttimeseriesarchivepfccold-storagejsonlquestdbpfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-export-cratedb

  Public
  Export CrateDB tables directly to PFC cold-storage archives with timestamp index

  exportlogsarchive+ 5

  exportlogsarchivecratedbpfccold-storagejsonlpfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-ingest-watchdog

  Public
  Automatic file watcher — monitors local folders or S3 prefixes and converts new files to PFC format

  automations3logs+ 6

  automations3logswatchdogpfcfile-watchercold-storagejsonlpfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-convert

  Public
  Convert legacy log/data formats (Apache CLF, CSV, NDJSON) to PFC cold storage format

  nginxcsvndjson+ 6

  nginxcsvndjsonpfccold-storagejsonlapache-logslog-converterpfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-archiver-questdb

  Public
  Autonomous archive daemon for QuestDB

  time-seriesdaemonarchiver+ 5

  time-seriesdaemonarchiverpfccold-storagejsonlquestdbpfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-archiver-cratedb

  Public
  Autonomous archive daemon for CrateDB cold storage

  time-seriesdaemonarchiver+ 5

  time-seriesdaemonarchivercratedbpfccold-storagejsonlpfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-migrate

  Public
  Convert any compressed JSONL archive to PFC cold storage — from S3, Azure, GCS or local disk. No intermediate files, no schema changes, no pipelines.

  pythoncompressionazure+ 8

  pythoncompressionazurepypis3migrationgcsglacierjsonllog-compression+ 1

  Python

  •

  MIT License

  •00 forks•11 star•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-fluentbit

  Public
  Stream Fluent Bit logs directly to PFC-JSONL compressed archives (.pfc). Free for personal and open-source use.

  fluent-bitlog-compressionduckdb+ 5

  fluent-bitlog-compressionduckdbfluent-bit-pluginstructured-logsfluent-bit-outputpfc-jsonllog-archiving

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-gateway

  Public
  HTTP REST gateway for PFC cold storage archives — query any time range without full decompression. Part of the PFC Ecosystem.

  rest-apigrafanagateway+ 6

  rest-apigrafanagatewaylogspfchttp-apicold-storagejsonlpfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-kafka-consumer

  Public
  Kafka consumer that compresses log messages directly to PFC format

  pythoncompressionkafka+ 7

  pythoncompressionkafkas3logsconfluentlog-managementobservabilityredpandapfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-otel-collector

  Public
  OpenTelemetry OTLP/HTTP log exporter for PFC-JSONL compression

  pythoncompressions3+ 6

  pythoncompressions3logslog-managementobservabilityopentelemetryotlppfc-jsonl

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-telegraf

  Public
  Telegraf output plugin — compresses metrics to PFC-JSONL format on local disk or S3

  compressioninfluxdbmetrics+ 7

  compressioninfluxdbmetricss3logstelegrafobservabilitypfcinfluxdatapfc-jsonl

  Python

  •

  Other

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-migrate-parquet

  Public
  Convert Apache Parquet files to PFC-JSONL cold storage. Streaming, in-region, no egress costs.

  compressionarrowmigration+ 7

  compressionarrowmigrationdata-engineeringparquetlog-managementcold-storagepyarrowpfc-jsonlimpossibleforge

  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 20, 2026May 20, 2026

• pfc-duckdb

  Public
  DuckDB extension to read PFC-JSONL compressed log files with block-level timestamp filtering

  compressionsqlanalytics+ 5

  compressionsqlanalyticsjsonllog-compressionduckdbduckdb-extensionstructured-logs

  C++

  •

  MIT License

  •00 forks•11 star•00 issues•00 pull requests•Updated May 19, 2026May 19, 2026

• pfc-py

  Public
  Python interface for PFC-JSONL

  pythoncompressionpypi+ 5

  pythoncompressionpypifluent-bitjsonllog-compressionduckdbstructured-logs

  Python

  •

  Other

  •00 forks•00 stars•00 issues•00 pull requests•Updated May 19, 2026May 19, 2026

• pfc-log

  Public
  High-ratio log compressor with block-level random access. 6.7% ratio on Apache/Nginx logs. Docker-ready.

  Other

  •00 forks•00 stars•00 issues•00 pull requests•Updated Apr 10, 2026Apr 10, 2026

• awesome-duckdb

  Public
  🦆 A curated list of awesome DuckDB resources

  Creative Commons Zero v1.0 Universal

  •198198 forks•00 stars•00 issues•00 pull requests•Updated Apr 9, 2026Apr 9, 2026