Web Sources
Web Sources allow Quick Publisher agents to generate content by scraping and repurposing articles from external websites.
Overview
A web source is a URL that UniSync monitors and extracts content from. When a Quick Publisher agent runs, it:
- Fetches the latest content from the web source
- Extracts the article text, images, and metadata
- Generates a unique article based on the extracted content
- Publishes to the target environment
Creating a Web Source
Navigate to Automations → Web Sources and click Add Web Source.
| Field | Description |
|---|---|
| URL | The website URL to scrape |
| Name | A descriptive label |
| Environment | Target publishing environment |
Content Extraction
UniSync uses intelligent extraction to:
- Identify the main article content (ignoring nav, sidebar, ads)
- Extract headings, paragraphs, and lists
- Capture relevant images
- Parse publication dates and author info
Assigning to Agents
Web Sources are assigned to Quick Publisher agents through the Assignment Modal:
- Go to Manage Agents
- Select an agent → Assign
- Choose Quick Publisher mode
- Add one or more web sources
Best Practices
- Choose high-quality, regularly updated sources
- Avoid sources with heavy JavaScript rendering (extraction may fail)
- Mix web sources with search phrases for content variety
- Monitor output quality — some sources produce better results than others
Related
- Search Phrases — Alternative automation type
- Quick Publisher — Agent mode that uses web sources
- Web Sources API — API endpoints