WP Content Crawler is a powerful WordPress plugin that automatically imports content from any website to your site. It supports full-text scraping, custom post templates, automatic translation, and scheduled crawling. Ideal for news sites, affiliate blogs, and niche content hubs, it helps you build and refresh content at scale while keeping everything organized, optimized, and compliant.
- Crawl and import content from any site with CSS/XPath selectors
- Auto-generate posts, pages, and custom post types
- Full-text extraction with pagination and multi-page support
- Schedule crawls with flexible intervals and cron control
- Translate content automatically via popular translation APIs
- Spin or rewrite text with supported AI/spinner integrations
- Extract and set featured images, galleries, and media
- Automatic taxonomy mapping for categories and tags
- Find-and-replace rules for clean, brand-safe content
- Custom post templates with dynamic shortcodes
- WooCommerce support for product import and pricing rules
- Duplicate detection and canonical URL handling
- Cookie, header, and login session support for protected sites
- Proxy and user-agent rotation to reduce blocks
- Detailed logs, test tools, and per-site settings for precision
