BLOX Digital provides several ways to manage automated traffic and protect your articles. Our infrastructure only blocks known malicious bots and users by default. You can also set crawling preferences, request specific firewall blocks, and use content encryption to restrict access to protected article text. Each option serves a different purpose.
How BLOX handles bots by default
Bots are automated programs that visit websites. Some of them support search engines and other useful services; others collect content or generate unwanted traffic.
By default, BLOX infrastructure blocks known malicious bots and users. Other bots are not automatically blocked, although unrecognized bots may be heavily rate limited. Rate limiting restricts how frequently requests can be made; it does not necessarily prevent access altogether.
Bot Blocking in BLOX Settings
The Bot Blocking setting in the BLOX admin manages your site’s robots.txt file. This file tells cooperating bots which content they should avoid crawling. Legitimate bots typically read and follow these instructions, but other bots may ignore them. This setting does not enforce a hard block against a user agent, which is the identifier a browser or bot sends with a request.
To configure your crawling preferences:
In the Application Menu, go to Other → Settings → Bot Blocking.
Choose Enable BLOX Digital automated bot blocking, Manually define user agents, or Disabled.
If you choose the manual option, use the Blocked User Agents tab to manage the list, then click Save.
You can review the published instructions at https://yourdomain.com/robots.txt. Disabling this admin setting changes the robots.txt instructions; it does not turn off BLOX infrastructure protections.
Web Application Firewall (WAF)
For restrictions that must be enforced, BLOX Digital can create customer-specific rules in our Web Application Firewall, or WAF. These rules can use user agents, IP addresses, JA3/JA4 fingerprints, and other signals. JA3/JA4 fingerprints help identify patterns in how a client connects.
For example, we can create a rule to block requests from a particular country while allowing specified IP addresses. Contact Support to discuss the traffic you want to block and any exceptions that should remain allowed.
BLOX Audience Content Encryption
A bot that reaches your website may still be prevented from reading the full text of a protected article. Through Access Control, content encryption adds protection to the article text itself, helping prevent unauthorized retrieval when a scraper or paywall bypass tool attempts to expose the content.
BLOX Audience encryption limits what an unauthorized visitor can retrieve to an article snippet, rather than revealing the full article when the paywall overlay is hidden. Encryption protects content covered by your access rules; it does not stop bots from visiting the site.
Contact Support to confirm availability for your current product and paywall configuration and to request enablement.
Support
When submitting a ticket with Support, the following would be helpful for our team while trying to help:
Example article URLs and the dates and times of unwanted activity, including the time zone.
Known bot names, user agents, or IP addresses, if available.
Any geographic restrictions you want and the IP addresses or services that should remain allowed.
Whether you want to limit crawling, enforce a traffic block, protect full article text, or explore licensed AI access.
