AegisAI Perspectives · 031
Choose an email security solution by testing it on your own mail against 12 checks: how it connects, what it can remove, and how it explains each verdict.

To choose an email security solution, test it on your own mail against 12 checks, starting from the built-in Microsoft 365 baseline, which Microsoft documents with a spam effectiveness SLA above 99%2. AegisAI is one example of the API model: it reads mail through the Microsoft 365 or Google Workspace API after delivery17. Each one ends with the question to put to a vendor.
Microsoft says the built-in security features for all cloud mailboxes help protect a Microsoft 365 organization from email threats, and are on by default1. Microsoft documents a spam effectiveness SLA above 99% and a false positive ratio SLA below 1:250,000 for those features.
AegisAI's inbound email security page prints one figure for that mail: 3 in 10 confirmed phishing emails cleared native Gmail and Microsoft filters in Q3 202623. Count that share on your own tenant before you buy.
Question to ask: how many confirmed threats did the product find in mail the built-in filter had already delivered, and how was each one confirmed?
An API-based tool fits a stack that must keep mail routing as it is. A secure email gateway (SEG) fits a stack that wants every message to pass through a filter before delivery. A gateway receives mail through an MX record change, so it sits in the delivery path. An API tool connects to Microsoft 365 or Google Workspace through an app the admin approves, and routing stays as it is.
The choice also decides what happens during an outage. If a gateway goes down, inbound mail waits for it. If an API tool goes down, mail keeps arriving while detection pauses. The guide on how to replace a secure email gateway without a cutover weekend covers running both side by side.
Question to ask: does deployment need a DNS MX change, and what happens to inbound mail if your service is down?
Both platforms require an admin grant before a third-party tool can read mail. Microsoft calls admin consent on behalf of an organization a sensitive operation, because it can give the app's publisher access to significant portions of the organization's data13.
Revocation differs by platform. In Microsoft Entra ID, an admin revokes organization-wide permissions from the enterprise application's Admin consent tab with the Revoke permission option14. In Google Workspace, Revoke access in the Data Access section removes all access for an admin-installed Marketplace app, and access cannot be revoked for specific scopes15. Keep the read grant and the removal grant apart, so the tool can be watched before it can delete anything. The checklist on how to evaluate API-based email security goes deeper on permissions.
Question to ask: which permissions does the app request, which of them can move or delete mail, and how do we revoke each one?
Judge an AI email security platform by the evidence it shows for each verdict.
Ask for three kinds of evidence. First, a reason for each verdict, in plain language, that an analyst can check against the message. Second, results on your own mail from a trial that ran in monitoring mode. Third, the denominator behind any accuracy figure: missed threats out of all threats, and false alarms out of all flagged mail. The page on how to evaluate detection accuracy and the false negative rate sets out that arithmetic. The explainer on how AI-powered email security works covers the models themselves.
Question to ask: for one blocked message and one allowed message from our trial, what reason did the model give, and which signals did it use?
Removal should reach every copy of a message, forwards included. It should also run on a grant the admin controls. When a tool finds one bad message, it needs to find and pull the other copies. Each removal belongs in a log. Removal is a write action, so it belongs on a separate grant that the admin approves after the monitoring period.
Question to ask: when you remove a message, do you remove the forwarded copies too, and where is each removal logged?
The three domain authentication records belong on it (SPF, DKIM and DMARC), because they let receivers check that mail claiming your domain really came from you. NIST SP 800-177 Rev. 1 names the three as mechanisms for authenticating a sending domain5. Microsoft says these DNS records let Microsoft 365 protect against spoofing more accurately4.
Google Workspace Admin Help says SPF helps prevent senders from impersonating you6. It also says DMARC lets you choose what happens to messages that fail SPF or DKIM. A security product does not replace these records. It should read their results as one signal per message, and keep the record for audits. The guide on how to roll out DMARC without breaking mail covers the records themselves.
Question to ask: does the product read the authentication results for each message, and does it flag mail that passes all three checks but still impersonates a supplier?
Test readiness with messages that carry no link and no attachment, such as a payment-change request. The FBI IC3 recorded 24,768 BEC complaints in 2025, against 21,442 in 20248. Reported BEC losses for 2025 were $3,046,598,558. Businesses also reported losses over $30 million to BEC scams involving AI.
Deepfakes move the same request into voice and video. The FBI says criminals use AI-generated audio to impersonate public figures or personal relations to get payments11. It also says criminals generate video for real-time chats with alleged company executives. A zero-payload email has no file to detonate and no URL to score, so detection has to read the request itself. Who is asking for the money, and does the request fit the sender's history? The guide on how to prevent business email compromise covers the payment controls around it.
Question to ask: how did the product handle a payment-change request with no link or attachment during our trial?
Treat every catch rate in a brochure as a claim until your trial reproduces it. A figure without a test method and a denominator cannot be checked. Run the trial in monitoring mode first, so the product reports verdicts and moves nothing. Then compare its findings with the mail the built-in filter delivered over the same weeks. The page on how to structure a read-only email security proof of concept lays out the steps.
Question to ask: what method and denominator produced this figure, and can we reproduce it on our own mail?
Compare four approaches on the same five criteria: mail routing, timing, access, outages and undo steps.
| Criterion | API-based | Gateway (SEG) | Built-in platform controls | Managed service |
|---|---|---|---|---|
| Mail routing | No MX change, connects through the platform API | MX record change, mail passes through it | No change, part of the mailbox platform | Set by the tool the provider runs |
| When it acts | After delivery, by removing mail from mailboxes | Before delivery, in the mail path | During delivery, inside the platform | Set by the tool the provider runs |
| Access it needs | An admin grant to read, a separate grant to remove | DNS control and connector rules | Included in the licence | Provider access to your tenant |
| During an outage | Mail keeps arriving, detection waits | Inbound mail waits for the gateway | Follows the platform's own uptime | Follows the tool and the provider's staffing |
| How to undo it | Revoke the app grant in Entra ID or Google Workspace | Restore the earlier MX records | Change policy settings | End the provider's access and grants |
Score each product yes or no on these 12 questions, using evidence from your own trial.
Did the trial run on your own mail, in monitoring mode first?
Did it report confirmed threats that the built-in filter had delivered?
Does deployment leave your MX records unchanged, or is the routing change planned and reversible?
Is every API permission written down before the admin grants it?
Does removal need a separate write grant?
Can an admin revoke every grant in Entra ID or Google Workspace?
Does every verdict come with a reason an analyst can check?
Does removal reach every copy, forwards included?
Does the product read authentication results for each message?
Did it handle a request with no link or attachment, such as a payment change?
Does inbound mail keep flowing if the product goes down?
Does each accuracy figure come with its method and denominator?
Through the Microsoft 365 or Google Workspace API, with an OAuth grant your admin controls and can revoke24. There is no MX change and nothing in the delivery path. Runs in monitoring mode first19. Removal needs write access your admin grants and can revoke. Every verdict comes with its reason in plain language, so your team can check it and share it.
Track three numbers from the first day of the trial.
The best email security solution is the one that passes the 12 checks above on your own mail. Run a monitoring-mode trial, count what the product found after the built-in filter, and check the reason behind each verdict.
Microsoft 365 already includes built-in protection that is on by default. Measure what still reaches inboxes on your own mail during a trial before you buy.
No. An API-based tool connects through the Microsoft 365 or Google Workspace API with an admin grant, so mail routing stays as it is. A gateway is the approach that needs an MX record change.
Yes. In Microsoft Entra ID, an admin revokes organization-wide consent from the enterprise application's Admin consent tab. In Google Workspace, Revoke access removes all access for an admin-installed Marketplace app.
No. DMARC tells receivers what to do with mail that fails SPF or DKIM. The FBI IC3 logged 24,768 BEC complaints in 2025.