Option to whitelist crawler IP addresses or User-Agent for website training data
Allow teams to whitelist the Fibi website crawler in their WAF/firewall by providing a published list of crawler IP addresses or a dedicated User-Agent string.
- What AI feature?
Log in to comment and vote
No comments yet
Be the first to share your thoughts.