Skip to dashboard tools

ScraperX Operations

Dashboard Home

Quick access to the ScraperX tools used to operate crawls, configure brands, onboard stores, and investigate failures.

Core Operations

Start Here

The operational views most useful for checking the current state of ScraperX.

System Status

View live due recurring crawls by processing region, current Hatchet queue depth, and rolling workflow completion and failure counts.

Open System Status

Crawl Sync Jobs Dashboard

Review recurring crawls, sync jobs, configs, and related run-state actions.

Open Crawl Dashboard

Crawl History

Browse crawl runs newest-first and inspect states, errors, and final stats.

Open Crawl History

Issues Dashboard

Triage crawling and extraction failures, resolve issues, and review history.

Open Issues Dashboard

Scout Readiness

Review active recurring-crawl health across ScraperX, Catalogix, and Scout.

Open Scout Readiness

Daily Operations

Operate Crawls

Manage crawl availability, sync delivery, and product data after a run starts.

Manage Crawl State

Manage recurring crawl and linked Catalogix sync-job ACTIVE or DISABLED states from one table.

Open Crawl State

Data Sync Queue

Review sync history, then drill into crawl status, sync status, and product previews.

Open Data Sync Queue

Products / Crawls Summary

Inspect product counts, state distributions, source URLs, categories, departments, and the latest crawl.

Open Products Summary

Brand Distribution

Fetch cross-system product and distribution snapshots without prefilled arguments.

Open Brand Distribution

Sync Artifacts

Browse Catalogix sync artifacts from the environment chooser with no default filters.

Open Sync Artifacts

Setup & Maintenance

Configure & Onboard

Prepare new brands and maintain the domain, region, and PLP configuration behind recurring crawls.

Config Editor

Edit linked domain and region configs, including XPaths, PLP XPaths, and scraper parameters.

Open Config Editor

PLP Manager

Open the PLP Manager for a known region config.

Use the region config key for the brand you want to manage.

Onboarding Events

Track onboarding milestones, delivery states, and time to first product for new rollouts.

Open Onboarding Events

Diagnostics

Build & Debug Extraction

Create, validate, and remediate the extraction configuration used to turn pages into products.

XPath Tester

Test stored PDP XPath extraction against live or provided HTML.

Open XPath Tester

PLP XPath Generator

Generate product-tile XPaths from a category page with FPM fetch settings and Anthropic models.

Open PLP XPath Generator

URL Extractor + Classifier

Extract product URLs from category-page HTML, then classify them by department and category.

Open URL Extractor

Automated Debugging

Review remediation runs, workflow triggers, config actions, and recommended next steps.

Open Automated Debugging

Issue Events Explorer

Review the chronological issue-events timeline for a domain, region, or crawl ID.

Open Issue Events Explorer

Legacy USC Tools

External Utility Pages

Secondary USC utilities that remain available for specific support and validation workflows.

Show 5 Legacy USC Tools

Web Content Fetcher

Open the FPM dashboard for web-content fetching and related inspection flows.

Open Web Content Fetcher

Pulse Stats Dashboard

Review pulse statistics and runtime signals from the Legacy USC control APIs.

Open Pulse Stats

USC Test Hub

Launch the Legacy USC utility and integration test hub.

Open USC Test Hub