Automatic WordPress Scraper Plugin

Scrapes is designed to provide maximum performance even in the minimum system configuration provided by shared hosting. However, issues such as the hardware specification of your server, the connection speed of your server and the source site, some limitations defined on your server, how many tasks you are running at the same time etc. are factors that affect performance. The minimum requirements are listed below.

• PHP 5.2.4+
• dom, mbstring, iconv, json and simplexml extensions for PHP
• Configurable maximum execution time for PHP
• WordPress 3.5+
• Google Chrome, Firefox, Safari or Microsoft Edge for admin panel

You can already copy the content of any site to your own WordPress site manually without any tools. Scrapes is simply an automatic WordPress scraper plugin that allows you to automate this process. In other words, this question is not related to Scrapes, and there is no clear answer to "Yes" or "No". Actually the answer differs according to the source site and your intended use of the content.

• Some aim to reach more users by sharing their content with content sharing systems such as RSS (Rich Site Summary) or API (Application Programming Interface).
• Some allow you to publish some of their content, ask you to give them the backlink to view the rest and target more hits.
• Some in exchange for publishing their products on your site, pay you under their affiliate marketing programs and aim to sell more.
• Some allow you to publish their content except commercial use.
• Some refer to extra protection methods in order not to scrape their contents.

Although it is entirely your responsibility to copy the content of any website, our recommendations for not doing something illegal and avoiding Google penalties of duplicate content are as follows.

• In necessary situation, you can contact the owner and request permission to publish the content in your site.
• Using an SEO plug-in that allows you to define a Canonical URL, you can specify which source is used.
• Change content to a different language with the translate feature, or spin and retrieve a new content with content spinner services.
• With the template feature, you can add credit information or the backlink directed to the origin URL to the end of the content in WordPress auto post plugin mode for example.
• You can publish a portion of the content by shortening it with Find & Replace feature instead of publishing the entire content.
• You can extract content in "Draft" status and publish it after making changes.

Scrapes is designed to run compatible with other WordPress plugins and themes however some themes and plugins may require some complex string type values called array like a:1:{i:20041001103319;s:4:"test";} which is not supported by our product.

In order to check your theme or plugin needs this type of strings, you can install free "Post Meta Inspector" plugin from https://wordpress.org/plugins/post-meta-inspector/. You will see an additional meta box on your posts / custom post types at the end of page like this screenshot after the installation. If every meta field has plain text values then you can easily use Scrapes to fill every data you need from the target website, otherwise you will need some manual edits after the scrape.

If the "Remember me" option is checked when logging in, the login information is stored in the browser as a cookie in encrypted form. You can extract content from resource sites which require logging, or using Cloudflare by defining these cookie values to Scrapes.

Scrapes can extract content from almost all sites and RSS feeds, except as noted type of sites below. You can find out whether the target you are planning to scrape is appropriate, by trying out the live demo of our product or by contacting us.

• The content should be loaded when the page is opened. JavaScript / Ajax technologies and post-loaded page content are not supported.
• On the listing page, there should be a "Pagination" or "Next page" button that redirects to the next page. The content pages which are loading dynamic content without address change like "load more" button pressing or using infinite scrolls are partially supported.
• On the listing page, there should be links in a given order and directed to the detail pages. Listing pages with links that are not positioned in a specific order, opening pages in a popup instead of link redirection, or loading content after page load action with JavaScript / Ajax technologies are not supported.
• The detail pages that are redirected from the listing page should have the same HTML page structure and must be a valid HTML. Non-valid detail pages with different HTML page structure may not be supported.
• RSS and Atom feeds with non-valid XML structure may not be supported by our RSS aggregator plugin for WordPress.

There is no any limitation in our WordPress autoblog plugin to add an unlimited number of tasks, However each task may consume 10 – 30 MB of RAM during the process and they may slow down or not work properly if you have too many tasks running at the same time considering your server resources.

In order to reduce performance loss and prevent IP bans we suggest you to reduce your tasks or edit them to run in different timespans.

It can create "Simple", "External" and "Virtual" WooCommerce products automatically from the target you want but "Grouped", "Variable" and "Downloadable" product types and product attributes are not fully supported currently.

What Scrapes can do is completely limited to your imagination. You can create a site that will have rich content and get click, generate ad revenue, or open a store and earn commission revenue with affiliate marketing programs.