Getting Started

Get your crawl file ready in 3 steps

1

Crawl your site

BERTlinker needs a CSV with at least a URL column and an H1 (or Title) column. Any of these free tools will give you what you need:

Screaming Frog

Industry-standard desktop crawler. Free for up to 500 URLs.

  • Windows, Mac, Linux
  • Exports Address, H1-1, Title 1

Sitebulb

Powerful desktop crawler. 14-day free trial with full Pro features (500,000 URLs).

  • Windows, Mac
  • Exports URL, H1, Title, Status Code

LibreCrawl

Free, unlimited, open-source crawler. No URL cap.

  • Browser-based, no install
  • Exports URL + H1 columns

advertools

Free Python library. Unlimited crawling via Scrapy.

  • pip install advertools
  • Outputs url + h1 fields
import advertools as adv

adv.crawl(
    "https://example.com",
    "output.jl",
    follow_links=True
)

Already have a crawl? Most SEO tools work out of the box — see Supported Tools for the full list of 20+ auto-detected formats.

2

Export as CSV

Make sure your export includes a URL column and either H1 or Title. On WordPress and Shopify, the page title usually matches the H1, so a Title column works fine.

Screaming Frog

  1. Go to the Internal tab
  2. Filter > HTML
  3. Export > save as .csv

Sitebulb

  1. Go to URL List
  2. Click Export
  3. Upload the .csv or .xlsx

LibreCrawl

  1. Run your crawl
  2. Click Export CSV
  3. File is ready to upload

advertools

  1. Crawl outputs a .jl file
  2. Convert: jl_to_csv("output.jl")
  3. Or load with pandas and save as CSV
3

Upload to BERTlinker

Drop your CSV on the upload page and we'll auto-detect the columns. Free for up to 1,000 pages — no account needed. Want to see what the output looks like first? Try the demo.

Upload Your Crawl

Free for up to 1,000 pages

Don't want to crawl? CMS shortcuts

WordPress

Install the Export All URLs plugin. Export as CSV — the Title column works as H1 on most themes where title = H1.

Shopify

Go to Products > Export for the native CSV. The Title column equals the H1 on product pages.