Agent communication error - 21001 - caused by wrong type of trust

I was working with a customer that had deployed several agents in the same domain as the OpsMgr servers, but when deploying to servers in other trusted domains, the following error occurred in the Agents OpsMgr event log:

Event Type: Error
Event Source: OpsMgr Connector
Event Category: None
Event ID: 21001
Date:
Time:
User: N/A
Computer: AGENT
Description: The OpsMgr Connector could not connect to MSOMHSvc/OPSMGRMS.customer.local because mutual authentication failed.
Verify the SPN is properly registered on the server and that, if the server is in a separate domain, there is a full-trust relationship between the two domains.

We checked the SPNs and they were set correctly and agents within the same domain had no issues with connecting to the OpsMgr servers.

The customer ensured me that the trusts, worked as they should because they accessed resources and applications across the domains without issues.

The problem was, that all trusts were created as External Trusts and not as Forest trusts. Among other differences, the External Trust contra the Forest trust does not support Kerberos authentication, which is an requirement for the OpsMgr agent to Management Server communication.

Therefore two solutions were possible, either remove the trusts and create them again as Forest trusts or introduce the OpsMgr Gateway Servers in the trusted domains.

Some additional information about the different types of trusts is listed below. (Links and summary kindly provided by my colleague Craig Forster)

External Trusts only support NTLM:

https://technet.microsoft.com/en-us/library/bb727065.aspx

“Access to resources between domains that are connected by an external trust requires Pre-Windows 2000 Compatibility. Because external trusts only support NTLM authentication, queries to a directory in a different forest are always handled as anonymous access.”

Forest Trusts work on Windows Server 2003:

https://technet.microsoft.com/en-us/library/cc757352(WS.10).aspx

Trusts between two Windows Server 2003 forests

It is possible to extend the transitivity of domain trusts within a single Windows Server 2003 forest to another Windows Server 2003 forest by manually creating a one-way or two-way forest trust. A forest trust is a transitive trust between a forest root domain and a second forest root domain. A one-way forest trust allows all users in one forest to trust all domains in the other forest; a two-way forest trust forms a transitive trust relationship between every domain in both forests. The transitivity of forest trusts is limited to the two forest partners; the forest trust does not extend to additional forests trusted by either of the partners.