Skip to content

[Client P1] Demonstrate ingesting public web resources + auto-sync #41

Description

@jaysanderson

Client feedback (email 2, priority sub-area under 1)

"We need to be able to demonstrate the ability to ingest publicly available resources from websites. And be able to sync."

Status

The capability EXISTS: Manage > Content registers a web source; the app crawls + cleans + ingests pages (apps/api/src/scheduler.ts syncSource, crawl.ts), and a daily scheduler re-syncs auto sources (runAutoSyncs) so new pages are picked up. It is not currently surfaced as a headline demo.

Action

  • Verify end-to-end on a real public source: register -> crawl -> ingest -> appears in search/library -> re-sync picks up new pages.
  • Make it demonstrable for the client (a clear Manage > Content walkthrough; confirm the sync cadence).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions