WP Content Crawler v1.14.0 WordPress Plugin

WP Content Crawler - Get content from almost any site, automatically!
Name WP Content Crawler
Genre WordPress Plugins
Latest Version v1.14.0
File .zip
Preview Live Demo
Report Contact Us

In the world of website management, staying updated and relevant is essential. That’s where WordPress plugins come into play. If you’re seeking a way to effortlessly gather and curate content from various sources to enrich your WordPress site, look no further than the WP Content Crawler plugin. This comprehensive guide delves into the ins and outs of content crawling, its benefits, and how WP Content Crawler can elevate your website management game.

Content Crawling: Unveiling the Concept

Content crawling is systematically scouring the internet for relevant information to be displayed on your website. It involves the automated extraction of data, which is then indexed and potentially displayed on your web pages. This method saves time and ensures your website remains up-to-date with fresh content.

The Significance of Content Crawling

Providing users with valuable and current content is paramount in the digital age. Regularly updated content engages your audience and pleases search engines, which favor sites with fresh information. Content crawling empowers website owners to streamline the process of content aggregation, ensuring that their visitors are greeted with the latest and most pertinent data.

WP Content Crawler: A Game-Changing Plugin

WP Content Crawler is a dynamic WordPress plugin designed to automate the content crawling process. Whether you’re a blogger aiming to curate diverse posts or an e-commerce entrepreneur looking to showcase product details from various vendors, this plugin caters to your needs. Its user-friendly interface and robust features make content aggregation a breeze.

Key Features

  1. Source Variety: WP Content Crawler supports various sources, from websites and RSS feeds to social media platforms. This versatility ensures that you can gather data from your preferred channels.
  2. Customization Options: Tailor the crawling process to your liking with customizable rules. Define keywords, exclude specific content, and set the frequency of updates to match your requirements.
  3. Auto-Tagging: Let the plugin categorize and tag content automatically, saving time and effort in organizing your newly acquired information.
  4. Media Download: WP Content Crawler goes beyond text by enabling the downloading of media files. Please ensure your articles have relevant images and videos to captivate your audience.

The Benefits You Reap


Manually searching, copying, and pasting content is labor-intensive. WP Content Crawler takes over these tasks, freeing your time for strategic activities like content optimization and user engagement.

SEO Advantages

Search engines reward websites that consistently offer updated content. By integrating WP Content Crawler, you ensure that your site remains a reliable source of information, enhancing your SEO rankings.

Diverse Content Streams

Diversify your content offerings by aggregating information from various sources. This enriches user experience and positions your website as a comprehensive knowledge hub.

Automation Streamlines Processes

Automation minimizes the risk of human errors while ensuring a consistent flow of new content. Set it up once, and let WP Content Crawler do the rest.

Implementing WP Content Crawler: A Step-by-Step Guide

  • Plugin Installation: Download and install the WP Content Crawler plugin from the WordPress repository.
  • Source Configuration: Define the sources you wish to crawl content from. This can range from news sites to industry-specific blogs.
  • Rule Customization: Tailor crawling rules to suit your content needs. Specify keywords, exclude irrelevant data, and set the frequency of updates.
  • Automation Activation: Once your rules are set, activate the automation process. WP Content Crawler will now gather, categorize, and display content based on your preferences.

What’s New (Changelog) in WP Content Crawler v1.14.0

v1.14.0 – 29 October 2023


  • Turns URLs shown in the test results into clickable links
  • Adds gpt-3.5-turbo-16k and gpt-3.5-turbo-instruct models to OpenAI GPT Short Code creator
  • Adds Updated, Deleted, and Other URL types to the Clear URLs Tool


  • WooCommerce Section is not shown in the multi-site environment when WooCommerce is not activated for the entire network but only for a single site.
  • Certain prompts used in [openai-gpt] short code cause an infinite loop, making PHP stop execution
  • Decode HTML entities of the JSON values found via Optionthe s Box
  • Contents found by Post Content Selectors must not be wrapped with a p element
  • Values of “0” found by CSS selectors must not be ignored
  • Remove empty HTML elements and comments setting causes a PHP fatal error for HTML elements containing too many nodes


  • Tested and works with WordPress 6.3, 6.2, 6.1, 6.0, 5.9, 5.8, 5.6, 5.5, 5.4, 5.3, 5.2, with PHP 8.2, 8.1, 8.0, 7.4, 7.3, with Chrome, Firefox, Opera, with WooCommerce 8.2, 8.1, 7.9, 7.8, 7.2, 7.1, 7.0, 6.9, 6.1, 5.2, 5.1, 4.9, 4.5
  • Updates third-party libraries
  • Minor fixes and improvements
  • Code quality improvements

    Sales Page of WP Content Crawler Plugin


    Free Download WP Content Crawler Latest Version



    Similar Posts