Why our crawler visited your website.
Last updated 28 September 2026
The short version
Madar OS makes software for businesses. To tell a business about it, we look for the contact address the business publishes on its own website, such as info@ or sales@. Our crawler reads your home page and at most two contact or about pages, keeps one address on your own domain with the page it was on, and nothing else. To be removed, write to privacy@madar-os.com and we will never contact that address.
What it does
- It identifies itself as
MadarContactCrawlerwith a link to this page. - It reads your
robots.txtfirst and follows it, by the internet standard for robots files (RFC 9309). - It fetches your home page and at most two pages that look like contact or about pages, one request at a time with a pause between, and never runs scripts or submits forms.
- It keeps only an address on your own domain, with the page it was on and the date. In the Gulf it keeps only role addresses such as info@ or sales@, never a person's.
- It never reads an address you have hidden on purpose, and never makes one up from a pattern.
- It visits a site once. It does not return to watch it.
How to block it
Add these two lines to your robots.txt and it will not read any page on your site:
User-agent: MadarContactCrawler
Disallow: /
How to be removed
Write to privacy@madar-os.com from the address, or name it. We add it to our do not contact list, and every email we send also carries a one click way to stop them. How we handle personal data is in our privacy policy.