CBD Validator - Consultant

We worked with CBD Validator – an independent digital resource that rates CBD oils and tinctures – to build a real‑time price‑analysis engine powered by web scraping. Our objective was to continuously collect, normalize, and surface up‑to‑date retail pricing across CBD products so that Validator’s 50‑point scoring system could factor in current market prices.

Project scope and approach

• Identified and mapped 20+ major CBD retailers and brand websites covering Validator’s existing product catalog.

• Developed Python‑based scrapers (Scrapy + Selenium) to extract product names, SKUs, pack sizes, and pricing data.

• Designed an ETL pipeline to clean, dedupe, and normalize scraped data into a centralized database.

• Built automated quality checks and anomaly detection to flag missing or inconsistent price entries.

Technical deliverables

• A scheduled scraping framework capturing price updates for 1,300+ CBD products.

• API endpoints feeding Validator’s front‑end with live pricing for integration into product scorecards and the “Top 100” rankings.

• Looker dashboards tracking price trends, competitor positioning, and margin analysis for Validator’s internal analysts.

Outcome
By adding real‑time price intelligence, CBD Validator strengthened its scoring methodology, improved the accuracy of its rankings, and enabled consumers to compare CBD product costs transparently – without relying on manual research or third‑party data feeds.