Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 

Repository files navigation

Crawloop Rockwell Automation Suite

Structured data extraction for Rockwell Automation and Allen-Bradley hardware catalog. Built for procurement teams, system integrators, and BOM engineering workflows.

All actors run on Apify — serverless, API-ready, pay-per-result.

Disclaimer: These are unofficial integrations developed independently of Rockwell Automation Inc. They are not affiliated with, sponsored by, or endorsed by Rockwell Automation Inc. or any of its subsidiaries.

Rockwell Automation, Allen-Bradley, and related names are trademarks of Rockwell Automation Inc. Product data is read from publicly accessible Rockwell web sources only; no proprietary databases are redistributed.

These tools are provided for informational and research purposes only (e.g. procurement research, BOM audits, internal engineering workflows). You are solely responsible for ensuring your use complies with applicable laws, Rockwell website terms of use, and your organization's policies.

No warranty is given as to accuracy, completeness, or continued availability of third-party data. Use at your own risk.

Marketing site: crawloop.com/rockwell-automation

Also from Crawloop Industrial: Siemens SiePortal Suite · GitHub docs


Actors

Discovery Enrichment Documents PDF parsing
Full Catalog Crawler Product Scraper Document Downloader Datasheet Parser
Lifecycle Tracker

Pipeline

Phase 1 — Discover SKUs           Phase 2 — Screen & enrich        Phase 3 — Documents & specs
─────────────────────────          ─────────────────────────        ─────────────────────────────

  Full Catalog Crawler ──► catalog numbers ──► Lifecycle Tracker ──► Product Scraper
                                    │
                                    ▼
                         Document Downloader (literature.rockwellautomation.com)
                         technical data, manuals, drawings
                                    │
                                    ▼
                         Datasheet Parser
                         specs from TD PDFs

Rockwell's public catalog is an Adobe AEM site backed by Elasticsearch via the product-details servlet. There is no global OneSearch-style API — the Full Catalog Crawler walks sitemap family pages and paginates PIM category IDs.

Estimated catalog size: ~20k–50k unique hardware SKUs (US), after deduplication across overlapping PIM categories.


Which actor do I need?

Your goal Start here
Build a full Allen-Bradley SKU list from catalog families Full Catalog Crawler
Get specs, literature PDFs, dimensions, accessories per catalog number Product Scraper
Bulk BOM check: lifecycle phase + replacement catalog numbers (fast, low cost) Lifecycle Tracker
Download TD PDFs, manuals, and drawings to Key-Value Store Document Downloader
Parse TD PDFs into structured JSON specs (no browser) Datasheet Parser

Use cases

BOM obsolescence audit — Run Lifecycle Tracker on your catalog number list. Filter discontinued parts and successors. Enrich only replacements with Product Scraper.

Procurement catalog build — Discover SKUs with Full Catalog Crawler. Export deduplicated catalog numbers with breadcrumbs for ERP or PIM import.

Technical documentation pack — Download literature PDFs via Document Downloader. Parse specification tables with Datasheet Parser.

High-volume TD extractionDocument DownloaderDatasheet Parser. HTTP download + parse-only chain, no browser on the parse step.


Pricing overview

Pay-per-event on Apify. You are billed only for successful results — not for NOT_FOUND or FAILED rows.

Actor Typical price
Full Catalog Crawler, Product Scraper, Lifecycle Tracker, Document Downloader from $2–5 / 1,000 results
Datasheet Parser (parse-only) $10 / 1,000 parsed PDFs

Exact pricing is shown on each Actor page in Apify Store before you run.


Quick start

  1. Create a free Apify account.
  2. Open the Actor you need from the table above.
  3. Paste your Allen-Bradley catalog numbers or configure discovery mode.
  4. Run — results appear in Dataset (JSON/CSV) or Key-Value Store (PDFs).

Example — check one catalog number lifecycle:

{
  "catalogNumbers": ["1756-L81E"],
  "concurrencyLimit": 1
}

Run on: Lifecycle Tracker

Example — full product record:

{
  "catalogNumbers": ["1756-L81E", "25B-E027N104"],
  "includeAccessories": true,
  "concurrencyLimit": 5
}

Run on: Product Scraper


API integration

All actors support the Apify API and official clients (apify-client for Python/JS).

pip install apify-client
from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("crawloop/rockwell-lifecycle-tracker").call(
    run_input={"catalogNumbers": ["1756-L81E"], "concurrencyLimit": 1}
)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item["lifecyclePhase"], item.get("replacementCatalogNumber"))

About Crawloop

Crawloop builds production-grade web data actors for industrial automation and other verticals. Actor source code is proprietary; this repository is the public product hub and documentation index.

Product site: crawloop.com/rockwell-automation · Related suite: Siemens SiePortal · GitHub docs

Questions or custom enterprise runs: open an issue in this repository or contact via Apify Store.


Repository structure

This repo contains marketing and documentation only. Actor source code is deployed privately to Apify Cloud.

Path Purpose
README.md This page — suite overview
docs/ GitHub Pages site (same content)

About

Crawloop Rockwell Automation Suite — Apify actors for Allen-Bradley catalog discovery, lifecycle checks, literature PDFs, and TD parsing.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors