Decodo icon

Decodo

Decodo's Web Scraping API

Reddit Subreddit

AI-generated

Overview

This node integrates with Decodo's Web Scraping API to scrape data from Reddit subreddits. It allows users to specify a subreddit name and optional parameters such as geolocation, markdown formatting, and sorting order of posts. The node is useful for scenarios where users want to programmatically retrieve and analyze Reddit posts from specific subreddits, for example, to monitor trends, gather community opinions, or perform sentiment analysis.

Use Case Examples

  1. Scrape the 'nba' subreddit to get the latest hot posts sorted by 'hot'.
  2. Retrieve posts from a subreddit with results formatted in markdown for easier readability.
  3. Specify a geolocation to tailor scraping requests based on country-specific content availability.

Properties

Name Meaning
Subreddit Name of the subreddit to scrape posts from, e.g., 'nba'.
Geolocation Country name from which the scraping request will be made, e.g., 'United States'. Optional parameter to influence scraping context.
Markdown Boolean flag indicating whether the results should be retrieved in markdown format.
Sort How to sort the posts of the chosen subreddit. Options include 'Best', 'Default', 'Hot', 'New', 'Rising', and 'Top'.

Output

JSON

  • json - The scraped data from the subreddit posts, including post details as returned by the Decodo scraping API.

Dependencies

  • Decodo's Web Scraping API

Troubleshooting

  • Common issues include invalid subreddit names or network errors when connecting to the Decodo API.
  • Error messages may indicate authentication failures if the API token is missing or invalid. Ensure the API credentials are correctly configured.
  • If the node fails to retrieve data, verify that the subreddit exists and is publicly accessible.

Links

Discussion