Weld GitHub Repositories icon

Weld GitHub Repositories

Extract repository data from GitHub repository URLs

Create

AI-generated

Summary

Creates a job to scrape GitHub repository data from provided repository URLs and optionally waits for completion to return the results.

Inputs

  • urls (required) — One or more GitHub repository URLs (newline or comma-separated, must start with http:// or https:// and belong to github.com).
  • jobName — Optional custom name for the scraping job.
  • waitForCompletion — When enabled, polls the job until completion and returns the extracted repository data directly.
  • pollInterval — Time in seconds between job status checks when waiting for completion (default: 10).
  • maxWait — Maximum time in seconds to poll before returning a timeout status (default: 300).
  • resultLimit — Maximum number of repository records to retrieve when waiting for completion (default: 1000).

Output shape

A single job creation summary object, or a list of scraped repository records.

When 'Wait for Completion' is false, outputs job creation details containing the jobId. When true, returns an item per extracted record augmented with _jobId and _scraperId, or a timeout summary object if execution exceeds maxWait.

Examples

Example 1: Start an asynchronous repository scraping job

Repository URLs: 'https://github.com/expressjs/express', Job Name: 'Express Scrape', Wait for Completion: false

Example 2: Scrape a repository and wait for results directly in the workflow

Repository URLs: 'https://github.com/n8n-io/n8n', Wait for Completion: true, Max Wait Time: 300, Result Limit: 500

Links

Discussion