Wp Crawly icon

Wp Crawly

Crawl WordPress endpoints

Wp Crawly

AI-generated

Summary

Fetch recent WordPress posts, pages, and media metadata from the specified website domain by querying its WordPress REST API endpoints.

Inputs

  • Domain (required) — The full URL of the WordPress website domain to crawl, e.g., https://example.com. The URL is normalized to ensure it starts with https:// and has no trailing slashes.

Output shape

a list of JSON objects, each containing the website URL, arrays of the most recently modified and oldest posts, pages, and media items with selected metadata (title, link, date), or an error message if data could not be fetched.

The response includes up to one newest and one oldest item per content type (posts, pages, media). If no data is found or a timeout/error occurs within 15 seconds per domain, the output object will contain an error message. Each item object includes fields like 'date', 'link', and 'title' derived from the WordPress API response.

Examples

Example 1: Crawl a WordPress site to get latest and oldest posts, pages, and media.

Set the 'Domain' parameter to the target site URL (e.g., https://mywordpresssite.com). The node returns recent and oldest posts, pages, and media metadata for use in further workflow processing.

Links

Discussion