Crawlomatic Multipage Scraper Post Generator is a powerful WordPress plugin that crawls, scrapes, and auto-publishes content from multipage websites. It collects articles, combines paginated content, cleans clutter, and posts optimized entries to your site—fully automated, SEO-friendly, and highly customizable for niche sites, news blogs, and content curation.
- Automatically crawl and scrape multipage articles into one clean post
- Set and forget automation with scheduled crawling and posting
- Advanced URL rules: include, exclude, depth, and domain controls
- Custom post templates with dynamic shortcodes and tokens
- Full content cleaning: remove ads, scripts, sidebars, and noise
- Built-in spinner and rewriting support for unique content
- Auto-generate titles, excerpts, featured images, and tags
- Smart pagination detection and merging for long-form articles
- Keyword and topic-based crawling for targeted niches
- Custom taxonomy, custom fields, and CPT support
- Automatic internal linking and source attribution options
- Powerful regex and CSS selectors for precise scraping
- Translation integration to publish content in your language
- Throttle, delay, and user-agent controls to mimic human behavior
- Built-in logs, error handling, and detailed crawl reports
