How does move mailbox really work?


Move mailbox is the best, supported way to move mailbox data between Exchange servers and update the directory object. It’s been around for ages and has been improved with each version. In Exchange 2003, for instance, the mailbox moves can now be scheduled and are multi-threaded to dramatically improve performance. Exchange 2003 SP1 added the ability to move mailboxes cross-site while still in mixed mode.


 


There are a number of resources on how to do move mailbox between Exchange servers (KB.224975 and KB.328810 are two good examples), but what’s missing is a good high-level description of what goes on behind the scenes to make it all happen. This post focuses on Exchange 2003, but much of this applies to earlier versions as well. There’s a bunch of additional steps required for cross-site moves, but those are covered in other places.


 


After you click the last “Next” in the move mailbox wizard what happens?


 


All of the data provided to the wizard is processed and the move actually begins. There are a number of distinct steps we’ll talk about that are part of the mailbox move.


 


1) Wait for the scheduled time to arrive


 


Exchange 2003 provides a new function that allows you to schedule the time/date of the mailbox move.   When you use this feature, the Exchange Task Wizard remains open on the final screen (unless you click the Cancel button) as a countdown to the scheduled time is displayed.


 


In any event, eventually the time of the move will be reached and the move will begin.


 


2) MAPI connection is opened to the source and destination servers


 


It’s important to understand that MAPI is used to facilitate the actual move. All Exchange servers have a basic server version of MAPI installed which is sufficient for the sort of MAPI operations that are required of the server, but note that this is a very different version of MAPI than is included with Outlook (it is because of conflicts between these two MAPI implementations that installing Outlook on an Exchange server is not a supported scenario).


 


The dependence on MAPI to move the data means that the requirements for MAPI connections must also be met for mailbox moves. For instance, an RPC connection must be made from the workstation or server running the move GUI to both the source server and to the server which is the destination of the move. If network ports are blocked between these systems, the MAPI connection won’t work. Similarly, if there is high latency or poor bandwidth availability in the network connections between these systems, this will also lead to poor mailbox move performance or failed moves.


 


3) Set PR_IN_TRANSIT flag in source mailbox


 


This is a flag stored in the source mailbox before the move begins to indicate to the source store that the mailbox is in the process of being moved. If this flag is set on a mailbox, this prevents the store from allowing new mail being delivered to the mailbox or other changes from being made to the mailbox during the move. It’s because of this flag that there’s no need to disallow logons to the mailbox while the mailbox is “in transit”.


 


4) Create the target mailbox


 


The mailbox is created in the target store and some of the basic mailbox properties and folders are set prior to moving the actual data. PR_IN_TRANSIT is also set on the target mailbox so that no mail delivery or logons will happen during the move.


 


5) Attempt to move the mailbox


 


For performance reasons, the mailbox move is attempted using a fast method that attempts to move the mailbox as a single object rather than moving each message individually. This move is done by calling the MAPI function IMapiProp::CopyTo() on the mailbox object. If the number of “bad items” selected within the wizard – this defaults to three – is exceeded during the move, the mailbox move fails and the progress is rolled back.


 


6) If the mailbox data is moved successfully, update the directory object


 


Once the mailbox data is all moved to the target store, the directory entry (or directory entries if 5.5 is involved in the move) need to be updated to reflect the new mailbox location. The AD attributes are: HomeMDB, HomeMTA, and msExchHomeServerName. The 5.5 attributes are: HomeMDB and HomeMTA.


 


The 5.5 directory updated by this process is that of the source server. If the source server doesn’t have a 5.5 directory, this step is skipped. If the target of the move is a 5.5 server, the move mailbox process also updates the HomeMDB and HomeMTA attributes directly at the target server in case the user logs into their mailbox before directory replication can happen.


 


If a mailbox is moved from an Exchange 2003 server to a server running an earlier version of Exchange (5.5 or 2000), the “wireless” attributes are also stripped off at this stage. These AD attributes are: msExchOmaAdminWirelessEnable and msExchOmaAdminExtendedSettings.


 


If these directory updates fail, the mailbox move is rolled back. If they succeed, then the mailbox move is done and it’s considered a successful move!


 


7) Clean up after a successful move!



If it’s been a successful move, we’ll have made a copy of all of the mailbox data from the source to the destination store. We won’t yet have done anything to the data in the source mailbox store (just in case the move had failed, we’d need to be able to roll back easily).


 


After the move is deemed successful, the mailbox in the destination store is updated to ensure the PR_IN_TRANSIT flag is no longer set. This will allow the user to login to the moved mailbox and will allow new mail (including any mail that queued up diring the move) to be delivered.


 


The mailbox in the source store is then removed and control is returned to the wizard so that the XML report of the mailbox move can be saved and reviewed!


 


Are there any myths about mailbox move I should know about?


 


A very common misconception is that the user must be logged off their mailbox while it is moved. This is not true, since as soon as the mailbox move is begun the PR_IN_TRANSIT flag is set on the mailbox which prevents further actions from occurring within the mailbox, protecting it during the move. There are a number of registry settings some folks have used to disable logons during mailbox moves, and while preventing logons during the mailbox moves won’t hurt anything, they’re simply not necessary.


 


Another myth is that the MTA must be running during an Exchange 2003 mailbox move. While this was the case in Exchange 5.5 and 2000, it is NOT the case in Exchange 2003. The MTA was required during mailbox moves in earlier versions of Exchange because when the PR_IN_TRANSIT is released on the target mailbox (in step #7, above), any mail that had been queued up for the moved mailbox would be dropped into the MTA for rerouting into the (now moved) mailbox destination. In Exchange 2003, this function is no longer reliant on the MTA routing and therefore the MTA is no longer involved in mailbox moves in this manner.


 


What happens to mail during the mailbox move?


 


During the time the mailbox is being moved, we’ve set this PR_IN_TRANSIT flag on the mailbox (on both the source and the destination mailbox). This tells the store that it cannot take local delivery of any mail into the mailbox that is being moved.


 


As mentioned above, in earlier versions of Exchange, during the mailbox move, mail is delivered into a special folder in the mailbox store as a temporary holding place until the mail can be delivered to the proper mailbox. Once the mailbox move is done, this mail is released to the MTA for rerouting into the destination store. However, in Exchange 2003 this is no longer the case.


 


In Exchange 2003, when mail fails to deliver due to the mailbox being marked “ecMailboxInTransit”, the mail is dropped into the “Messages queued for Deferred Delivery” queue within SMTP. After the mailbox move is completed and PR_IN_TRANSIT is released, the mail is rerouted through Store Driver and SMTP advanced queuing so that it is directed to the appropriate destination mailbox. This all happens transparently in the background.


 


What about stopping the ADC during mailbox move?


 


In a mixed-mode Exchange environment, the ADC can interfere with intra-site mailbox moves. If the ADC is running and a conflicting change is made to the directory object, the HomeMDB attribute can be reset to the source server. If this happens, the mailbox will appear to be “split” between the source and the destination server. To avoid this situation, be sure to stop the ADC when moving mailboxes between servers in the same site (see KB.299473 for more info). Also, be sure you don’t make any changes to mailbox objects using the 5.5 Administrator GUI while you’re moving mailboxes from the Exchange System Manager on Exchange 2000/2003!


 


Note that this behavior does NOT affect mailbox moves cross-site. ADC does not need to be stopped while moving mailboxes between sites using the Exchange 2003 SP1 feature.


 


- Evan Dodds

Comments (22)
  1. Adam Gates says:

    Great Info!!! Thanks for the "Myth" info it is going to help a lot.

  2. Ron Robbins says:

    Evan,

    Any ideas on what happens to the message sourcekey during the move? Is it maintained? Great article. Thanks!

    Ron

  3. Anonymous says:

    Exchange-faq.dk – Din portal til Microsoft Exchange Server information

  4. Excellent article! Especially the info about PR_IN_TRANSIT – I always thought that the user must be logged off during the move… Makes things a lot easier.

  5. Deepak Khajuria says:

    How is Target mailbox created during mailbox move , normal documented API does not allow to create a second (orphaned) mailbox for a user ?

  6. Richard Allen says:

    When I move a mailbox from Exchange 2000 SP3 to Exchange 2003 SP1, the mailbox exists on both servers, with all the messages on the Exchange 2000 server.

    The move wizard states the move was successful

    Any ideas please?

  7. evan says:

    Ron –

    Can you explain what you mean by "message sourcekey"?

    Evan

  8. evan says:

    Deepak –

    This is true. The public APIs for creating mailboxes won’t let you create a new mailbox while the existing mailbox is still in place to ensure mailbox uniqueness. The integrated Move mailbox process splits the process out into mailbox data and directory data parts (as described above), and uses the lower-level APIs inside the store to create only the mailbox data objects (not an additional set of conflicting directory objects) at that stage of the move.

    Evan

  9. evan says:

    Richard –

    If you’ve confirmed that the mailbox REALLY IS on both stores (ie – make sure you refresh, etc to ensure the source mailbox list is updated), then it sounds like it actually did NOT complete successfully. The source mailbox object should be removed when the mailbox move is completed. If this is the scenario, you may wish to post in the Exchange newsgroups or open a PSS support incident to get to the bottom of this behavior!

    Evan

  10. Ron says:

    Evan,

    I am referring to the attribute called PR_Source_Key on the messages and folders in Exchange. This field is populated whenever a message or folder is created in Exchange and is used to uniquely identify a message or folder. If the value is not maintained it can sometimes have an adverse affect on Rules and permissions. It is also used by the ICS to sync folders.

    I was wondering if the value remains the same after the mailbox move. I am pretty sure that with ExMerge the value is not retained and is repopulated when the message and/or folder is placed in the new mailbox. I was wondering if this was the behavior when you use move mailbox as well.

    Thanks again!

    Ron

  11. evan says:

    Ron –

    Thanks for the clarification. Yes, the PR_SOURCE_KEY property *IS* maintained during a move-mailbox operation.

    Evan

  12. 机票 says:

    /archive/2005/02/

  13. Eric Domazlicky says:

    Do you have to update the profile on the Outlook client to reflect the new move? What about if you move with ADC?

    I have heard that Outlook profiles update automatically when you move I hope this is true.

  14. evan says:

    Eric –

    Two possible answers here:

    1) For moves within the site (ie – the moves that you’ve always been able to do), or for moves between sites when you’re in Exchange 200x native mode, you do NOT need to do anything with the Outlook profile. Outlook will attempt to connect to the original server the next time you start Outlook and will be automatically redirected to the proper server.

    2) For move ACROSS sites in Exchange 200x mixed mode (the new Exchange 2003 SP1 feature), you DO have to run the Exprofre tool or recreate the Outlook profile. This is because the mailbox is no longer really associated with the same directory object. I talk about this a bit more on my blog: http://blogs.msdn.com/evand/archive/2004/08/24/219579.aspx

    Evan

  15. Bharat Pallod says:

    You said that ADC replication doesn’t to be put off during cross-site moves in mixed mode. Could you please put some more light on that, because what I thought was ADC need to put off in cross-site moves either.

    ~Bharat

  16. evan says:

    Bharat –

    Nope, no need to stop the ADC during cross-site moves. The problem during within-the-site moves is that if the object is changed somewhere else in the 5.5 directory before the ADC can replicate in the "new server" info (HomeMDB/HomeMTA) from the AD, the 5.5 change is newer and overwrites the values in the AD. All of a sudden, all of the mail is on the target server, but the new inbound mail is going back to the original server. KB.299473 talks about this in more detail.

    In cross-site moves, since the source object becomes a "stub" object, it doesn’t really matter much for mail delivery. X500:ADCDoNotReplicate is set on it, and the ADC will ignore it if it is updated with incorrect values. The (new) target object is created in the target site using the (correctly updated) AD info.

    So, it DOES matter that the ADC is not replicating during mixed-mode mailbox moves in the traditional sense. But for mixed-mode, cross-site moves with the Exchange 2003 SP1 feature, there is no need to ensure the ADC is not replicating during the moves.

    Hope it helps!

    Evan

  17. Migration Grunt says:

    For moves within a site, you state, outlook profile changes automatically. What would cause it not to change automatically?

    I can create a profile using the old mail server and it will then find the actual mailserver. But if i use the existing profile with the old mailserver, profile will not automatically switch (unless, manually "check name"). Any ideas?

  18. evan says:

    Migration Grunt –

    When you login to the mailbox after the mailbox has been moved, you will make a connection to the original mailbox server (presuming this server is still up and running). This server will "know" that the mailbox has been moved (because it can consult the directory and see the updated HomeMDB/HomeMTA). The original server will then "tell" the Outlook client "hey, you’re on SERVER-X now" and Outlook will update its profile to reflect this automatically.

    So, in short, sure there are things that can break this process. But so long as the original server is still up and running, and so long as the directory is updated and replicating properly, this process should be quite automatic.

    Evan

  19. Jesse Cadd says:

    What about moving mailboxes across WANs? Is there a better method than exmerging to pst, creating a new mailbox, and exmerging back in? Numberous articles (yours included) note that the move mailbox wizard performs poorly across a slow link, and it also swamps the link w/ all the data that must be moved. I wish there was a "bandwidth" throttle on the move mailbox wizard.

    }-]

  20. evan says:

    Jesse –

    Where WAN bandwidth or latency is poor for doing these moves, you may want to do the following:

    1) Exmerge out the data to PST

    2) Move the (now empty) mailbox across the WAN

    3) Exmerge back in the data from PST

    This way you’re not having to delete and recreate the mailbox.

    Evan

  21. Jesse Cadd says:

    Of course! It’s so obvious once you state it. Thanks!

    }-]

  22. Anonymous says:

    I have been asked some questions recently regarding the Cross-site mailbox moves using the native tools…

Comments are closed.

Skip to main content