OpsMgr 2007 R2 CU5 rollup hotfix ships – and my experience installing it


The Cumulative Update 5 (CU5) for OpsMgr 2007 R2 has shipped

 

image

 

The KB article describing the fixes, changes, and instructions:

http://support.microsoft.com/kb/2495674

Get it from the download Center:

http://www.microsoft.com/download/en/details.aspx?id=26938

List of all OpsMgr R2 Cumulative Updates:

http://support.microsoft.com/kb/2453149

 

 

Here are the high level fixes:

 

    Cumulative Update 5 for Operations Manager 2007 R2 resolves the following issues:

    • Restarts of non-Operations Manager services when the agent is updated is resolved.
    • UI hang caused by SDK locking.
    • Web console is timing out while opening the left navigation tree.
    • Reports – Drill-through fails due to rsParameterTypeMismatch in the EnterpriseManagementChartControl.
    • Reports – Edit Schedule button is disabled with SQL Server 2008 R2.
    • Reports – Scheduled Reports view for Windows Server 2003 and SQL SRS 2005 SP3 CU9 – returns System.IndexOutOfRangeException: Index was outside the bounds of the array.
    • ACS – Event log message is truncated or corrupted in SCDW.
    • ACS Filter fails for certain wildcard queries.
    • ACS – Updated ACS reports
    • Workflows – TCP Port Probe incorrectly reports negative ping latency.
    • Workflows – MissingEvent Manual Reset Monitor does not work as expected.
    • Workflows – Signed MPs cannot be imported when new attributes are added to existing classes.

Cross Platform Cumulative Update 5 for Operations Manager 2007 R2 resolves the following issues:

  • Performance data for LVM managed partitions is not available
  • Process monitor does not retain name if run via symbolic link
  • AIX with large number of processes crashes with bad alloc

Cross Platform Cumulative Update 5 for Operations Manager 2007 R2 adds the following features:

  • Support for Red Hat 6

Note The new agent for Red Hat 6 is included in Cumulative Update 5. The management pack for Red Hat 6 can be downloaded by visiting the following Microsoft webpage:  System Center Operations Manager 2007 R2 Cross Platform Monitoring Management Packs (http://www.microsoft.com/downloads/details.aspx?FamilyID=b15fef5c-e331-4006-8913-be376bb0e0c1)

 

Let’s Roll:

 

So – first – I download it. The hotfix is about 950 MB.  While still substantial, this is smaller than many previous CU’s.

Now – before your heart rate starts rising…. understand… this update combines the Cross Plat CU with the OpsMgr CU. (CU3 and CU4 did this as well) Aligning these is a very good thing – but it ends up increasing the size of the initial download. No worries though – I will demonstrate how to only have to copy specific files to lessen the impact of distributing this update to all your management servers and gateways, if copying a 1GB file around is a problem for you.  Read about that here:  http://blogs.technet.com/b/kevinholman/archive/2010/10/12/command-line-and-software-distribution-patching-scenarios-for-applying-an-opsmgr-cumulative-update.aspx

 

Next step – READ the documentation… understand all the steps required, and formulate the plan.

I build my deployment plan based on the release notes in the KB article. My high level plan looks something like this:

  1. Backup the Operations and Warehouse databases, and all unsealed MP’s.
  2. Apply the hotfix to the RMS
  3. Run the SQL script(s) update against the OpsDB AND Warehouse DB.
  4. Import the updated management packs provided.
  5. Apply the hotfix to all secondary Management Servers.
  6. Apply the hotfix to my Gateway Servers.
  7. Apply the hotfix to my agents by approving them from pending
  8. Apply the hotfix my dedicated consoles (Terminal servers, desktop machines, etc…)
  9. Apply the hotfix to my Web Console server
  10. Apply the hotfix to my Audit collection servers
  11. Update manually installed agents…. well, manually.

Ok – looks like 11 easy steps. This order is not set in stone – it is a recommendation based on logical order, from the release notes. For instance – if you wanted to update ALL your infrastructure before touching any agent updates – that probably makes more sense and would be fine.

****Requirement – as a required practice for a major update/hotfix, you should log on to your OpsMgr role servers using a domain user account that meets the following requirements:

  • OpsMgr administrator role
  • Member of the Local Administrators group on all OpsMgr role servers (RMS, MS, GW, Reporting)
  • SA (SysAdmin) privileges on the SQL server instances hosting the Operations DB and the Warehouse DB.

These rights (especially the user account having SA priv on the DB instances) are often overlooked. These are the same rights required to install OpsMgr, and must be granted to apply major hotfixes and upgrades (like RTM>SP1, SP1>R2, etc…) Most of the time the issue I run into is that the OpsMgr admin logs on with his account which is an OpsMgr Administrator role on the OpsMgr servers, but his DBA’s do not allow him to have SA priv over the DB instances. This must be granted temporarily to his user account while performing the updates, then can be removed, just like for the initial installation of OpsMgr as documented HERE. At NO time do your service accounts for MSAA or SDK need SA (SysAdmin) priv to the DB instances…. unless you decide to log in as those accounts to perform an update (which I do not recommend).

  

Ok, Lets get started.

 

 

1.   Backups. I run a fresh backup on my OpsDB and Warehouse DB’s – just in case something goes really wrong. Since I haven’t grabbed my RMS encryption key in a long while – I go ahead and make a backup of that too, just to make sure I have it somewhere.

I also will take a backup of all my unsealed MP’s. You can do the backup in PowerShell, here is an example which will backup all unsealed MP’s to a folder C:\mpbackup:

Get-ManagementPack | where {$_.Sealed -eq $false} | export-managementpack -path C:\MPBackup

We need to do this just in case we require restoring the environment for any reason.

 

2. Apply the hotfix to the RMS.

Tip #1: Here is a tip that I have seen increase the success rate: Reboot your RMS/RMS nodes before starting the update. This will free up any locked processes or WMI processes that are no longer working, and reduce the chances of a timeout for a service stopping, file getting updated, etc.

Tip #2: If you are running any SDK based connectors – it is a good idea to stop these first. Things like a Remedy product connector service, Alert Update Connector, Exchange Correlation Engine, etc… This will keep them from throwing errors like crazy when setup bounces the SDK service.

Tip #3: If you are low on disk space, and you have previously installed prior R2-CU’s, you can uninstall those and make sure they are removed from \Program Files (x86)\System Center 2007 R2 Hotfix Utility\ directory. This can free up a substantial amount of disk space, and once applied these files are no longer necessary.

Tip #4:  If you are running the Exchange Correlation Service for the Exchange 2010 MP, it might be a good idea to disable this service during the CU update.  This service uses a lot of resources and would be best to keep it out of the picture for the CU process.

****Note: If applying this update to a RMS cluster – FIRST see: How to apply a SCOM hotfix to a clustered RMS

****Note: Many people struggle with OpsMgr hotfixes – for failing to follow instructions. When applying an OpsMgr hotfix – you need to copy the downloaded MSI file (such as SystemCenterOperationsManager2007-R2CU5-KB2495674-X86-X64-IA64-ENU.MSI) to EACH and EVERY Management server and Gateway. You need to INSTALL this hotfix installer utility to EACH Management Server and Gateway. Don’t try and just copy the update MSP files. This wont work and you will fail to update some components. Common complaints are that the agents never go into pending actions, or the agent update files never get copied over to the \AgentManagement folders. In almost ALL cases, people were taking a shortcut and making assumptions. Don’t.  Copy the 1GB file to each machine, then install the hotfix utility, then run the hotfix from the splash screen that comes up, immediately after installing the downloaded MSI. The only acceptable alternative to this process – is to install/extract the 1GB MSI to a workstation, and then build a command line based package as described below. For memory limited test environments – the command line method is the way to go.

Since my RMS is running Server 2008 R2 – I need to open an elevated command prompt to install any SCOM hotfixes. That is just how it is. So I launch that – and call the MSI I downloaded (SystemCenterOperationsManager2007-R2CU5-KB2495674-X86-X64-IA64-ENU.MSI).  This will install the Hotfix Utility to the default location.  I always recommend installing this hotfix utility to the default location.  You can always uninstall the utility later to clean up disk space.

Tip: (This part may take a LONG TIME to complete if calling the 1GB file on a system will limited memory resources. This is because it must consume 1GB of RAM to open the file, temporarily. For production systems meeting the minimum supported 4GB, this probably wont be as much of an issue. For virtualized labs and test environments where you are running very limited memory, (1-2GB RAM) you will see this process take a considerable amount of time. On my 1GB memory virtualized management servers, it would not install at all. I upped them to 2GB and they took about 10-20 minutes to open and run the setup program. See section at the end of this article **Command line install** for ideas on how to mitigate this issue if affected)

Eventually – a splash screen comes up:

image

I choose Run Server Update, and rock and roll. You MUST execute the update from this “Run Server Update” UI.  NO OTHER METHOD will work.

It runs through with success, I click finish – then another setup kicks off.  This is by design. There should be three actual setups running consecutively (once for the core update, one for the localization, and one for Xplat.)

You could see this potentially three times:

image

After clicking finish on the 3rd one, I was prompted with this:

image_thumb4

So – you should plan for a reboot. Hit OK. (it wont reboot automatically)

 

Then wait around 30 seconds for any post install processes to complete, and then click “Exit” on the splash screen.

image

If you have trouble at with this stage – get some error messages, or if the installation rolls back – see the troubleshooting and known issues at the KB article and below in this post. There are two known and fairly common issues encountered with simple resolutions.

If you are patching a clustered RMS – you can continue the process using the link posted above – and complete the second node.

Now – it is time to validate the update applied correctly. I can see the following files got updated on the RMS in the standard install path: \Program Files\System Center Operations Manager 2007\

image

**note – this isn’t all the files included in the hotfix package, just a spot check to make sure they are getting updated.

Next I check my \AgentManagement folder. This is the folder that any agents will get updates from. I check the \x86, \AMD64, and \ia64 directories:

image

It is good – that our KB2495674 CU5 agent MSI’s got copied over.  In this CU5, we did remove the previous CU files if they existed.

***NOTE – it is CRITICAL to perform the next step in this order. The SQL scripts MUST be deployed at this time, immediately after installing the update on the RMS. If you don’t, your alert views could be empty. You could see multiple events on the RMS about errors from the SDK (26319) and DataAccessLayer (33333). The RMS will not generate new config until these scripts are executed. Your consoles might also show the following, until you run the SQL scripts:

image

 

3. Time to run the SQL scripts. There are 2 scripts, located on the RMS, in the \Program Files (x86)\System Center 2007 R2 Hotfix Utility\KB2495674\SQLUpdate folder:

  • CU5_Database.sql
  • CU5_DataWarehouse.sql

Let’s start with CU5_Database.sql

I simply need to open this file with SQL management studio – or edit it with notepad – copy the contents – and paste it in a query window that is connected to my Operations (OperationsManager) Database. I paste the contents of the file in my query window, it takes about a minute to complete in my lab. It will return a single string of output stating MPLastModified with a timestamp, upon success.

Next up – we now need to connect to the Warehouse database instance, and open a new query window against the OperationsManagerDW database. We will execute CU5_DataWarehouse.sql which will return “Command(s) completed successfully”.

***  Note – one of the files inside the text, still says “CU4” – just ignore that, its good to go

 

DO NOT skip step number 3 above, and do not continue on until this is completed.

 

 

4. Next up – import the MP updates. That’s easy enough. They are located at \Program Files (x86)\System Center 2007 R2 Hotfix Utility\KB2495674\ManagementPacks\ and are named:

  • Microsoft.SystemCenter.DataWarehouse.Report.Library
  • Microsoft.SystemCenter.WebApplication.Library.mp
  • Microsoft.SystemCenter.WSManagement.Library.mp

These will upgrade existing MP’s in your environment. They take a few minutes each to import.

At this point – if you are using cross platform monitoring for Unix agents – you would upgrade the Xplat MP’s via a separate download. See the KB article for steps on this, and potentially upgrading your Unix agents if required.

 

 

5. Time to apply the hotfix to my management servers. I have 1 secondary MS server which is  Windows Server 2008 R2 SP1.  So I open an elevated command prompt to run the hotfix utility MSI,

Again – I MUST RUN SystemCenterOperationsManager2007-R2CU5-KB2495674-X86-X64-IA64-ENU.MSI on each Management server. This installs the hotfix utility, which will then launch the splash screen.

Tip: (This part may take a LONG TIME to complete if calling the 1GB file on a system will limited memory resources. This is because it must consume 1GB of RAM to open the file, temporarily. For production systems meeting the minimum supported 4GB, this probably wont be much of an issue. For virtualized labs and test environments where you are running very limited memory, you will see this process take a considerable amount of time. On my 1GB memory virtualized management servers, it would not install. I upped them to 2GB and they took about 10-20 minutes to open and run the setup program. See section at the end of this article **Command line install** for ideas on how to mitigate this issue if affected)

Once the splash screen comes up I “Run Server Update” These all install without issue (again – three setups run consecutively). I spot check the \AgentManagement directories and the DLL versions, and all look great. REMEMBER – you can sure patch all your management servers at the same time, however, your agents WILL fail over during this time because we stop the MS HealthService during the update. Keep this in mind. It is best to update management servers one at a time, synchronously, to keep your agents from failing over to the RMS and overloading it, or causing massive Heartbeat failures because they have nowhere to report to.

Note: You might see a “Restart Required” pop up after the last setup routine is complete. Just ignore this for now and hit OK, and then we will need to reboot this server when we are finished.

 

6. Next up – any Gateway machines here. Since my gateways all have limited memory, I don’t want to run the full 1GB MSI. I am running these from a command line which uses a LOT less resources. I build a local install package in my local C:\temp\ directory from my article at this LINK using the following command line modified for CU5:

SetupUpdateOM.exe /x86msp:KB2495674-x86.msp /amd64msp:KB2495674-x64.msp /ia64msp:KB2495674-ia64.msp /x86locmsp:KB2495674-x86-ENU.msp /amd64locmsp:KB2495674-x64-ENU.msp /ia64locmsp:KB2495674-ia64-ENU.msp /Agent /noreboot

I “Run Gateway Update” from the splash screen, and setup kicks off. It runs three separate installs and I see the following – 3 times:

image_thumb1

Remember to spot check your DLL versions and \AgentManagement directories. They both should be updated.

 

7.   I check my Pending Management view in the Administration pane of the console – and sure enough – all the agents that are set to “Remotely Manageable = Yes” in the console show up here pending an agent update. I approve all my agents (generally we recommend to patch no more than 200 agents at any given time.)

After the agents update – I need to do a quick spot check to see that they are patched and good – so I use the “Patchlist” column in the HealthService state view to see that. For creating a “Patchlist” view – see LINK

Out of a total of 14 total agents in my lab – 11 of them patched perfectly. One was down (turned off) so those don’t patch very well.  Smile  Two of them that failed, failed with a timeout.  They are SQL servers, on a VM disk that is massively saturated with I/O and not designed anything like what we would see in production.  I gave those some additional I/O by migrating some of the other VM’s off their disk volume, and ran the pending update again – with success.

 

image

 

The CU5 actually REPLACES any previous patches applied in the PatchList table – this is NICE. Looks good. (Note) I will have to formulate a plan to go and update my manually installed agents (Remotely Manageable = No)

Note: See the KB article if your agents will not update. If you previously applied CU3, CU4, or if your agents require a reboot from a previous windows installer package – you cannot update them until they receive a reboot. Normally an agent side reboot is not required for updating an agent. It will only be required if it falls into one of these two specialized situations.

 

8. I have a few dedicated consoles which need updating. One is a desktop machine and the other is my terminal server which multiple people use to connect to the management group. So – I kick off the installer – and just choose “Run Server Update” as well. I do a spot check of the DLL files – and see the following was updated on the terminal server:

 

image

I can also perform a “Help > About” in the console itself – this will now show the update version for your console:

image

 

9. Next up – Web Consoles. I run mine on a stand alone management server, which I have already patched with CU5.  So – I will simply just go check their DLL files to ensure they got updated. 

From: \Program Files\System Center Operations Manager 2007\Web Console\bin

image

 

Additionally – there are some manual steps needed to secure the Web Console from a client side script vulnerability, per the KB Article:

Update the Web.Config file on the Web Console server role computers

  • To ensure that all cookies created by the web console cannot be accessed by client cscript, add the following configuration to the Web.Config file on each Web console server:

<httpCookies httpOnlyCookies="true"/>

  • If the web console is configured to run under SSL, add the following configuration to ensure all cookies are encrypted:

<httpCookies httpOnlyCookies="true" requireSSL="true"/>

Now – ONE of these lines need to be added to your web.config file.  Scroll down in that file until you see the   <system.web> tag.  You can add one of these on a new line IMMEDIATELY after the  <system.web> line.  Here is mine – before and after:

image     image

Use the correct line based on your SSL configuration status for your web console.  Reboot your web console server to pick up these changes.

 

 

10. At this point – I update ACS components on any ACS running Management servers that have already been patched with CU5 – but this time run the update and choose to “Run ACS Server Update”

image

 

11.  Manually installed agents. I have a fair bit of these… so I will do this manually, or set up a SCCM package to deploy them. Most of the time you will have manually installed agents on servers behind firewalls, or when you use AD integration for agent assignment, or when you installed manually on DC’s, or as a troubleshooting step.

 

Additional Activities:

 

12.  Since this particular environment I am updating is going from CU2 to CU5 – I need to import the latest cross platform management packs.  If I am not using and don’t desire to use OpsMgr to monitor cross platform OS’s like SUSE, RedHat, and Solaris… then I can skip this step.  However, if I do want to be fully up to date for Xplat monitoring – I need to ensure I have the latest Xplat MP’s available.  The ones that are version .277 are current:  http://www.microsoft.com/download/en/details.aspx?displaylang=en&id=18891

 image

13.  I need to update the ACS reports, if I am using ACS.  We have included in the CU5, some new reports which fix some reported issues with the reports.  These can be found at: 

C:\Program Files (x86)\System Center 2007 R2 Hotfix Utility\KB2495674\ACS\Reports

image

 

At this point I would browse to my Sql Reporting Services website that hosts my ACS reports, and import these RDL’s over the existing reports, or place them in a new folder for testing, and then move them later.

Now – the update is complete.

image

The next step is to implement your test plan steps. You should build a test plan for any time you make a change to your OpsMgr environment. This might include scanning the event logs on the RMS and all MS for critical and warning events… looking for anything new, or serious. Testing reporting is working, check the database for any unreasonable growth, run queries to see if anything looks bad from a most common alerts, events, perf, state perspective. Run a perfmon – and ensure your baselines are steady – and nothing is different on the database, or RMS. If you utilize any product connectors – make sure they are functioning.

The implementation of a solid test plan is very important to change management. Please don’t overlook this step.

 

*** Command line install option

 

In some situations, you might want to perform a command line installation of the update on your RMS/management server. Most of the time – I don’t recommend this, because you generally need the feedback if each part was successful or not. However, there are situations where it is required.

One example is for users who have issues with the 1GB MSI file, and getting the hotfix installer running, especially on limited memory systems. For those, you can use a command line options which removes the issue.

For additional command line options, including how to make a CU package smaller, and how to patch consoles, agents, etc…. see the KB article which contains some guidance, and the following post which contains command line package ideas from a previous CU:

http://blogs.technet.com/b/kevinholman/archive/2010/10/12/command-line-and-software-distribution-patching-scenarios-for-applying-an-opsmgr-cumulative-update.aspx

 

 

Known issues/Troubleshooting:

 

1.  CU4 update installation entry still exists in Add/Remove Programs after you upgrade to CU5
We plan to resolve this issue in Cumulative Update 6.

2.  New management packs cannot be edited in the authoring console after the Cumulative Update is installed
When a new management pack is created after CU4 or CU5 is installed and then an attempt is made to edit the management pack in the Authoring console, the Authoring console cannot edit the management pack because it cannot find the latest version of the Microsoft.SystemCenter.Library Management Pack (build .61 for CU4 and build .81 for CU5).  This is resolved – please see:  http://support.microsoft.com/kb/2590414

3.  CU5 fails to apply. The SDK or config service may not start after this, and CU5 fails on subsequent retries. The installation rolls back and you get a dialog box that the setup was interrupted before completion. There are two possible issues, with workarounds to this. One is caused by a general timeout, the other is a .NET 2.0 Issue due to a CRL response delay. Start with workaround “#1” and if that fails, try workaround “#2”. #2 is a fairly rare condition.

Workaround #1:

The services are timing out while trying to start. Using http://support.microsoft.com/kb/922918 set the ServicesPipeTimeout entry for all services to have 3 minutes (180000 milliseconds) and REBOOT the server. Then try and apply CU4. It should apply. You likely will see a few warning messages about failure to start the OMCFG service – just click ok and the setup will continue.

Workaround #2:

Using Follow the steps that are outlined in Microsoft Knowledge Base article KB936707

***Note: This hotfix likely will not be required. The hotfix is ONLY required if you are still running .NET 2.0 RTM. This hotfix is included in .NET 2.0SP1 and later. The hotfix does not resolve the issue, simply put – the hotfix (or .NET 2.0SP1 or later) simply ENABLES the use of a new tag in XML which will allow for disabling of CRL checking. If your RMS is on Windows Server 2008 or 2008R2 – you already have this hotfix included.

***Note: Once you have verified you have .NET 2.0 SP1 or later installed – you MUST perform the second step – which involves editing 2 application.exe.config files. The KB article is misleading in that it tells you to add this information as an entire section – which is incorrect – you must find the <runtime> section in your existing config files – and add a SINGLE new line to that existing section.

The manifest files are located on the RMS at the \Program Files\System Center Operations Manager 2007\ root directory. The manifest files will need to be edited for the config and sdk service on affected RMS. The file names are:

  • Microsoft.Mom.Sdk.ServiceHost.exe.config
  • Microsoft.Mom.ConfigServiceHost.exe.config

In between the EXISTING <runtime> and </runtime> lines – you need to ADD a NEW LINE with the following:

<generatePublisherEvidence enabled="false"/>

This solution disables CRL checking for the specified execute-ables, permanently.

4.   Agent patchlist information incomplete, or CU5 patching failure. The agent Patchlist is showing parts of CU5, or CU5 but also CU4, CU3, CU2 or CU1 or nothing. The CU4 localization ENU update is not showing in patchlist. This appears to be related to the agents needing a reboot required by Windows Installer from a previous installation package. Once they are rebooted, and a repair initiated, the patchlist column looks correct with the CU5 and CU5 ENU (localized) information. The correct and complete patchlist information will appear as below:

System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674); System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674) – ENU Components

If you apply Cumulative Update 3 or 4 for Operations Manager 2007 R2, the pushed agent may not display the update list correctly. This issue occurs because the agent updates in Cumulative Update 3/4 for Operations Manager 2007 R2 may require a restart operation and then a repair operation. If you do not restart these servers after you apply Cumulative Update 3/4 for Operations Manager 2007 R2, the agent updates in Cumulative Update 5 for Operations Manager 2007 R2 are not applied. However, the restart required state is set on these computers. Therefore, you have to restart these computers and then repair the agent to apply the updates in Cumulative Update 5 for Operations Manager 2007 R2.

 

5.   Other issues:  Please see other known issues from the KB article, which are not discussed here.


Comments (80)

  1. Anonymous says:

    Thanks Kevin…worked perfectly!

  2. Kevin Holman says:

    @joe –

    Did you open a case with Microsoft?  There are no known issues where this is a problem with Cu5 that I am aware of.

  3. Kevin Holman says:

    @ Peter –

    All steps are covered in the KB article and my blog.  There is no reporting server role update in this CU.

  4. Kevin Holman says:

    @Kitaab –

    Yes – there is a specific step to update the ACS collector components.  This is covered in the KB article and in Step 10 above.

  5. Kevin Holman says:

    Hi Bob!

    To determin the previous CU version applied – use all the spot-checks in this article to get a "state of the union".  DLL versions of the specific DLL's I show in the spot checks is a great way.  Also look in the agent update directories.

    Yes – you can apply the latest CU once you have identified what version you are dealing with.  You might consider waiting just a bit for CU6, which is scheduled to be out soon.

  6. Kevin Holman says:

    the remove/repair you are getting is simply for the hotfix installer utility.  Just run repair and it will launch the splash screen again.  Then run the acs update.

  7. Kevin Holman says:

    @happytohelp –

    I recommend you install CU6, which is the latest CU.

  8. Anonymous says:

    Hi Kevin,

    it's super nice and a very useful guide! Thanks

    And here is what  I found. If there are two management groups using the same DW, it has to appy CU5 to both RMS clusters of each management group before running CU5_DW.sql. Otherwise, it will fail. 🙁

    CU5_DB.sql is just fine.

    – Dong

  9. Kevin Holman says:

    @Michael and RHC –

    If your patchlist is not showing up correctly – most likely the agent monitored server needs a reboot for one of the components to apply correctly.  This would be VERY common if you havent rebooted the server in a long time.  One of the MSI's could not install due to a pedning reboot.  I would recommend testing this by rebooting the server, then running a repair – and see if it shows up correctly then.

  10. Anonymous says:

    Kevin, great job again!

    Guess you could use a lot of text from the CU4 update 🙂 but compliments are in place.

    Just installed it in my Lab and is running perfectly!

    Keep up the good work!

  11. Kevin Holman says:

    @Stanislav –

    #1 – I'd follow my steps exactly.  When you choose to reboot the RMS (if that was required) is up to you.

    #2 – Again – when you choose to reboot is up to you.  It isn't that relevant.

  12. Kevin Holman says:

    @techexp –

    I assume this is hanging when you try and run the large 1.2GB MSI file?  Are you running this on Server 2003, 2008, or 2008R2?

  13. Kevin Holman says:

    @Deepesh – all elaboration is covered in the above post.

    @CCA – I have not heard this.  Does this happen when you run the console on your desktop or on the server?  Did you patch your desktop console as well?

  14. Anonymous says:

    Hi Kevin,

    I am facing an issue with this CU5 update. The Patch List shows "System Center Operations Manager 2007 R2 Cumulative Update 4 (KB2449679); System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674); System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674) – ENU Components;" even I have restarted the server.

    Please help.

    Thanks,

    Deepesh

  15. Anonymous says:

    Kevin,

    Thanks for the great instructions.  Although I have one problem.. how do I manually update agents?  Do I run both .msp files in the C:Program Files (x86)System Center 2007 R2 Hotfix UtilityKB2495674Agent directory (per respective platform)?

  16. Kevin Holman says:

    @VSN –

    Agents are placed into pending actions based on the following criteria:

    1. Agents are only placed into pending at the time the CU is applied – placing agents into pending is a post-install action of the CU itself.

    2. Agents will only be placed into pending that are directly assigned to the RMS/MS that is being updated.

    3. Agents will only be placed into pending if their “Remotely Manageable” flag is set to true/yes.

    If an agent(s) is not placed into pending upon patching a RMS/MS with a CU, one of the following is true:

    1. The agent(s) did not meet the criteria above.

    2. The CU failed, or was not applied correctly, in order to allow the pending agent insert action to occur.  The most common causes of this are not following instructions, not running from an elevated CMD (UAC), the management server needs a reboot from a previous MSI installation, not running from the splash screen, etc….

    If you feel neither 1 or 2 apply, then the steps in the CU are failing for some external reason (DNS resolution, lack of resources, etc..) and only troubleshooting via the CU log will offer a solution.  

  17. Kevin Holman says:

    @Huy –

    How long was the old agentless cluster machine removed before you added the agent on the machine with the same name as the old cluster resource?

    This is uncommon…. it is very possible that what happened is that since it was deleted, we only mark the object as deleted in the database – but it still exists for 2-3 days until it gets groomed.  If you deployed the SCOM agent, it is very possible that we dont re-create the relationship correctly – and in the DB the machine is still managed by the old cluster node, and not by the management server it is now managed by.  You can try some things:  1.  Uninstall the agent and ensure it is deleted in the Agent Managed, and ensure that it is not showing up under Agentless at all, and wait 3 days.  This is a good approach if you cant make any headway any other way.  2.  Rename the server and install agent (unlikely possible)   3.  There is a method via powershell to set the primary relationship with a management server for a healthservice – get-managementserver and set-managementserver.  Check on the powershell commands for Gateway managed devices on technet for the commands.

  18. Kevin Holman says:

    @ Mahendra –

    Sure!  Just reject them before you apply CU5.  Once you apply CU5 – they will go back into pending for CU5.

  19. Kevin Holman says:

    @coaxke –

    CU4 did not ever reboot a server.  Automatically or otherwise.  What happened – was that CU4 tried to update a DLL, that other services had a lock on – so RestartManager (a component of Windows 2008) tried to restart these *services* to free the lock so the DLL could be updated without having to recommend a server reboot and update the DLL on the next reboot.

    CU5 fixed two things:  The updated EventCommon.dll will not leak the handles which other processes can grab.  Additionally, CU5 update disables the use of restartmanager so we will not try and restart the services.  We will log an event in the application event lot if the agent update neeeds a restart in order to fully update the eventcommon.dll.

  20. Kevin Holman says:

    @Mike –

    A) Monitoring will continue.  Take as long as you need to update the agents.

    B) You do not have to manually update the agents – they will go into pending for an update, and you simply approve them.  If agents were manually installed – then they will not go into pending and you will have to manually update them.  I have another blog post on how to get agents back to remotely manageable if needed.  If you delete an agent, it will not skew the warehouse data, as we consider the FQDN the unique ID and create the BaseManagedEntity GUID based on it.

  21. Anonymous says:

    Hi Kelvin,

    I have installed CU5 update in lab setup. Installation went fine.

    Can you please elaborate things need to checked to make sure that this update will not break anything in production?

  22. MedeBay says:

    I have never seen any good documentation regarding any concerns over which you do first, update agents or OpsMgr servers. In our environment I am required to test the agent on pilot groups. To do this I need to do it one of two ways.

    1. Update a couple hundred agents before the backend is updated. These agents may be at CU5 a week before the OpsMgr servers are.

    2. Update the OpsMgr serers. then test a couple hundred agents. This means the OpsMgr servers vould be at CU5 for a week before all the agents are updated.

    So the question is: Is one of these options better than the other? Or is neither a good option?

    Brian

  23. Anonymous says:

    hi Kevin,

    Currently we have SCOM 2007 R2  6.1.7221.0 RTM Version, we want to keep server up-to-date with CU 1-5 so could you suggest which CU need to install either go one by one CU.

    we have two servers,

    1) RMS

    2) MS

    SQL DB on Cluster.

    Can you give me any Idea how I can drive to keep up-to-date my SCOM server.

    Regards,

    Sushant.

  24. Kevin Holman says:

    @Wilson –

    Cumulative updates, are cumulative.  You can go to CU5 from R2 RTM, CU1, CU2, CU3, or CU4.

  25. Kevin Holman says:

    @ AlHoarth9 –

    You can do that, apply both independently, or use my blog post on creating a command line installation and agent package for a single command to fully patch the agent.

  26. Kevin Holman says:

    @Brian –

    Brian – I would always advise applying a CU to the infrastructure first, then applying to the agent pilot group.   This is very typical for a deployment.  I even have customers who sometimes do not ever deploy the CU to the agents.  They might implement a CU only to the infrastructure for fixes that really apply more to the server side than the agent side.  Of course I recommend both….   but in general I would always follow a MOF/ITIL approach, testing in a lab, then a pre-pilot, then production.  Using a test plan each time to validate function, and to look for unknown/unexepected anomolies.

    @Bill –  thanks!  Looking forward to your thoughts on OM12.  OM12 will have a minimum CU level for upgrading your OM2007 environment, and that CU hasn't been decided yet… but that means implementing CU5 is probably going to be worth it.

  27. coaxke says:

    Thank you very much indeed – I intend to update our CU3 installation ASAP.

    Are you able to advise if the agent update to CU5 will not reboot my servers automatically like CU4 did? I would rather avoid this if possible.

    Thanks and Regards,

    Patrick S

  28. Anonymous says:

    Hi Kevin

    I've seen today by accident that in the "System Center 2007 R2 Hotfix UtilityKB2495674Reporting" the following files "KB2495674-x64-Reporting.msp, KB2495674-x86-Reporting.msp" are available. According to your manual the reporting server should not be updated separately. Are you aware what this files (msp's) are used for?

    Thx a lot

  29. Kevin Holman says:

    @Jarrad –

    Great question.  I recommend installing ALL of the infrastructure (RMS, MS, DB roles, reporting, etc…) and THEN applying the CU to all of this, THEN deploy agents.  You dont want to deploy agents, then apply and update with a CU, because that is double the work.

  30. Kevin Holman says:

    @RNC – on web.config – this was added to the current KB – support.microsoft.com/…/2495674

    @Deepesh – your issues is covered in the KB – the first item under "known issues".  support.microsoft.com/…/2495674

  31. Kevin Holman says:

    @cellodom –

    That was included in the CU for a very specific reason – but it is not used and not to be installed.  It is a leftover item from a previous build of the CU.  Ignore it, it is just files in a folder.

  32. Michael Christiansen(scom.dk) says:

    Thanks Kevin!

    Just installed it on my test environment, works like a charm.

    In this package they even added a shortcut for launching the setup with the correct parameters(remember to run as elevated)

    /MCHR

  33. KB Article to address known issue 2 – Microsoft.SystemCenter.Library management pack  version 6.1.7221.81 is availabile for download.

    support.microsoft.com/…/2590414

  34. Wilson W. says:

    I haven't read through all of the notes yet, but is it ok to go directly from CU3 to CU5 or does Microsoft recommend installing the cumulative updates in sequential order?

  35. Bill Carlson says:

    Hey Kevin! Glad to see you still have a toe in OpsMgr. Thanks for the post, we'll be loading this one up soon and are already looking at the OM12 Beta.

  36. Blake Mengotto says:

    Thanks again Kevin.  I will let other's know that we upgraded our lab environment from CU3 to CU5 today and the only issue I had was that the SDK couldn't connect after running the SQL scripts.  Bouncing the SQL services on the Ops DB and DW resolved the issue.

    discussitnow.wordpress.com/…/scom-cu5-patch-and-my-experience

    – Hugs

  37. mike says:

    Hi There, just a couple of quick questions for you regarding the agents as this will be the first time for installing the CU. We have a few hundred servers and what I'd like to know is

    A) if I update the server one night and then spread out the agent update over a week will they remain monitored with the old agent or will monitoring stop?

    B) Do we have to manually update the agents or is there  a quicker way? i.e. could I remove the agent using the console and then reapply it using the console and if I did would this cause SCOM to see them as new servers which would then skew historical data in the ware house?

    Many thanks

  38. mike says:

    Thanks Kevin, that helps a lot I'll be able to plan this properly now. I've checked and all our agents are remotely managable so with luck and you guide it should all go through smoothly.

    BTW the guide is great.

  39. Jeffrey says:

    Hi Kevin,

    there are 3 web.config files on the webserver:

    – In the root folder

    – In the Mobile folder

    – In the RSS folder

    just to make sure, do i have to update all of them?

    Thanks in advance!

  40. Huy Nguyen says:

    Thanks again Kevin!  I have successfully upgraded my SCOM R2 environment to CU5 by following your steps.  Question:   I have a server that I am unable to monitor with SCOM.  I can manually install the agent and it shows up in SCOM and once I approve the agent, it just sits in the "Not monitored" state.  This server name was once a print server cluster resource and was agentless managed but we have moved it to a VM.  I think there must still be a residual entry in the OpsMgr DB somewhere.  Tried running this against the OpsMgr DB "exec p_AgentPendingActionDeleteByAgentName 'agentname.domain.com" but it didn't help.  Any suggestions?

    Thanks,

    Huy

  41. sgislain says:

    Hi! We have upgraded from CU4 to CU5 and also upgraded client. Even after reboot and reapir the patchlist looks like this:

    System Center Operations Manager 2007 R2 Cumulative Update 4 (KB2449679); System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674); System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674) – ENU Components;

    Why is the CU4 entry still showing? Is it an error or can we ignore this and consider it successful? The file versions on the client all seems to be of version 6.1.7221.81.

    Thanks,

    Sven-Erik

  42. hans de jongh says:

    hi, i followed the steps but within the console everything still shows with version number 6.1.7221.0 is that correct?

  43. Huy Nguyen says:

    @Kevin-

    >>How long was the old agentless cluster machine removed before you added the agent on the machine with the same name as the old cluster resource?

    That cluster resource was removed about a year ago.  The two physical cluster nodes are still being monitored by SCOM and they are providing agentless monitoring for the other cluster resources withing that cluster.   I was going to try removing the rest of the agentless monitored cluster resources and then uninstall/reinstall the SCOM agent on the physical nodes to see if that will clear up the phantom cluster machine entry.  Do you think this is a reasonable

    approach?

    Thanks,

    Huy

  44. mike says:

    Hi all,

    Well I've done the upgrade and it's almost completely perfect, I have one issue that hopefully someone can help me with?

    When approving the agents a handful (around 10) fail and do not update, as a test on one server I tried several ways to get the agent running, (reinstall, uninstall, repair etc and got no joy it just would not work. at this point I manually uninstalled the agent and tried to rediscover and could not, I have installed the agent manually and updated it but it does not appear in SCOM despite setting the management group.

    Does anybody have any ideas on this, the server I tried this on isn't critical so we can do without monitoring on it but the other are extremley critical.

    Many thanks in advance

  45. ML49448 says:

    Hi Kevin,

    I have successfully updated all agetns in my environtment, but only one agent in the Agent Version list displays CU5. I have restarted the servers and made a repair, but they are still appearing as CU4. I have checked the file version of the files on the servers, they are all 6.1.7221.81, so they have been updated. Whats up? Thanks.

  46. RHC says:

    Hi Kevin

    I have the same problem as SEB, our patch list shows "System Center Operations Manager 2007 R2 Cumulative Update 4 (KB2449679); System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674); System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674) – ENU Components;"

    Is this a known problem? and can I fix it?

    – RHC

  47. VSN says:

    I have upgrade scom cu4 to cu5 but scom agents are not reflecting in pending management. I have followed guideline given by Kelvin in Step2:-Apply the hotfix to the RMS. Issue is still persisting.

  48. Jarrad says:

    Hi Kevin,

    Awesome blog once again. Used it already 3 times. I have a question for you though regarding CU's in general. When deploying Ops Mgr for the first time is there any recommendations as to when to apply the current CU? i.e after all roles have been deployed or update as roles are installed? i've never been quite sure and can't find any supporting articles.

    Many thanks,

    Jarrad

  49. Peter says:

    Hello Kevin!

    What about updating SCOM Reporting Services? Is there any doing?

    Peter

    PS: Great Job – great Article – thanks for your input !!!

  50. Mahendra says:

    Thanks for the very detailed step by step!!

    I have one question: I have some agent s that are still in pending status from a previoues CU install. Can I go to CU5 without upgrading these?

    Thanks

  51. Joe says:

    The OpsMan Config service keep crashing:

    Problem signature:

    P1: microsoft.mom.configservicehost

    P2: 6.1.7221.81

    P3: 4dfa7aed

    P4: System

    P5: 2.0.0.0

    P6: 4db90c9f

    P7: 38d7

    P8: 127

    P9: System.ArgumentException

    P10:

    and in the WER:

    Version=1

    EventType=CLR20r3

    EventTime=129621466737912539

    ReportType=2

    Consent=1

    ReportIdentifier=c5d7d45b-edfc-11e0-9983-18a905681d86

    Response.type=4

    Sig[0].Name=Problem Signature 01

    Sig[0].Value=microsoft.mom.configservicehost

    Sig[1].Name=Problem Signature 02

    Sig[1].Value=6.1.7221.81

    Sig[2].Name=Problem Signature 03

    Sig[2].Value=4dfa7aed

    Sig[3].Name=Problem Signature 04

    Sig[3].Value=System

    Sig[4].Name=Problem Signature 05

    Sig[4].Value=2.0.0.0

    Sig[5].Name=Problem Signature 06

    Sig[5].Value=4db90c9f

    Sig[6].Name=Problem Signature 07

    Sig[6].Value=38d7

    Sig[7].Name=Problem Signature 08

    Sig[7].Value=127

    Sig[8].Name=Problem Signature 09

    Sig[8].Value=System.ArgumentException

    DynamicSig[1].Name=OS Version

    DynamicSig[1].Value=6.1.7601.2.1.0.274.10

    DynamicSig[2].Name=Locale ID

    DynamicSig[2].Value=1033

    UI[2]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ConfigServiceHost.exe

    LoadedModule[0]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ConfigServiceHost.exe

    LoadedModule[1]=C:WindowsSYSTEM32ntdll.dll

    LoadedModule[2]=C:WindowsSYSTEM32MSCOREE.DLL

    LoadedModule[3]=C:Windowssystem32KERNEL32.dll

    LoadedModule[4]=C:Windowssystem32KERNELBASE.dll

    LoadedModule[5]=C:Windowssystem32ADVAPI32.dll

    LoadedModule[6]=C:Windowssystem32msvcrt.dll

    LoadedModule[7]=C:WindowsSYSTEM32sechost.dll

    LoadedModule[8]=C:Windowssystem32RPCRT4.dll

    LoadedModule[9]=C:WindowsMicrosoft.NETFramework64v4.0.30319mscoreei.dll

    LoadedModule[10]=C:Windowssystem32SHLWAPI.dll

    LoadedModule[11]=C:Windowssystem32GDI32.dll

    LoadedModule[12]=C:Windowssystem32USER32.dll

    LoadedModule[13]=C:Windowssystem32LPK.dll

    LoadedModule[14]=C:Windowssystem32USP10.dll

    LoadedModule[15]=C:Windowssystem32IMM32.DLL

    LoadedModule[16]=C:Windowssystem32MSCTF.dll

    LoadedModule[17]=C:WindowsMicrosoft.NETFramework64v2.0.50727mscorwks.dll

    LoadedModule[18]=C:WindowsWinSxSamd64_microsoft.vc80.crt_1fc8b3b9a1e18e3b_8.0.50727.6195_none_88e41e092fab0294MSVCR80.dll

    LoadedModule[19]=C:Windowssystem32shell32.dll

    LoadedModule[20]=C:Windowssystem32ole32.dll

    LoadedModule[21]=C:Windowssystem32profapi.dll

    LoadedModule[22]=C:WindowsassemblyNativeImages_v2.0.50727_64mscorlib8f7abb6f7384aad8fc43659820726eabmscorlib.ni.dll

    LoadedModule[23]=C:WindowsMicrosoft.NETFramework64v2.0.50727mscorsec.dll

    LoadedModule[24]=C:Windowssystem32WINTRUST.dll

    LoadedModule[25]=C:Windowssystem32CRYPT32.dll

    LoadedModule[26]=C:Windowssystem32MSASN1.dll

    LoadedModule[27]=C:WindowsWinSxSamd64_microsoft.windows.common-controls_6595b64144ccf1df_5.82.7601.17514_none_a4d6a923711520a9COMCTL32.dll

    LoadedModule[28]=C:Windowssystem32CRYPTSP.dll

    LoadedModule[29]=C:Windowssystem32rsaenh.dll

    LoadedModule[30]=C:Windowssystem32CRYPTBASE.dll

    LoadedModule[31]=C:Windowssystem32imagehlp.dll

    LoadedModule[32]=C:Windowssystem32ncrypt.dll

    LoadedModule[33]=C:Windowssystem32bcrypt.dll

    LoadedModule[34]=C:Windowssystem32bcryptprimitives.dll

    LoadedModule[35]=C:Windowssystem32USERENV.dll

    LoadedModule[36]=C:Windowssystem32GPAPI.dll

    LoadedModule[37]=C:Windowssystem32cryptnet.dll

    LoadedModule[38]=C:Windowssystem32WLDAP32.dll

    LoadedModule[39]=C:Windowssystem32SensApi.dll

    LoadedModule[40]=C:Windowssystem32Cabinet.dll

    LoadedModule[41]=C:Windowssystem32DEVRTL.dll

    LoadedModule[42]=C:WindowsMicrosoft.NETFramework64v2.0.50727mscorjit.dll

    LoadedModule[43]=C:WindowsassemblyNativeImages_v2.0.50727_64System3e6eefab37b44e147db80a3c34f0ac05System.ni.dll

    LoadedModule[44]=C:WindowsassemblyNativeImages_v2.0.50727_64System.ServiceProce#d69463a51d3536074bff664c0a097b1fSystem.ServiceProcess.ni.dll

    LoadedModule[45]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ConfigServiceBridge.dll

    LoadedModule[46]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ConfigService.dll

    LoadedModule[47]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.Common.dll

    LoadedModule[48]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ConfigService.DataAccessAbstraction.dll

    LoadedModule[49]=C:WindowsassemblyGAC_MSILSystem.Configuration2.0.0.0__b03f5f7f11d50a3aSystem.Configuration.dll

    LoadedModule[50]=C:Windowssystem32VERSION.dll

    LoadedModule[51]=C:WindowsassemblyGAC_MSILSystem2.0.0.0__b77a5c561934e089System.dll

    LoadedModule[52]=C:WindowsassemblyGAC_MSILSystem.Xml2.0.0.0__b77a5c561934e089System.Xml.dll

    LoadedModule[53]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ConfigService.OpsMgrDataAccess.dll

    LoadedModule[54]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.DataAccessLayer.dll

    LoadedModule[55]=C:Windowssystem32oleaut32.DLL

    LoadedModule[56]=C:WindowsassemblyGAC_64System.Data2.0.0.0__b77a5c561934e089System.Data.dll

    LoadedModule[57]=C:Windowssystem32WS2_32.dll

    LoadedModule[58]=C:Windowssystem32NSI.dll

    LoadedModule[59]=C:Program FilesSystem Center Operations Manager 2007Bid2ETW.dll

    LoadedModule[60]=C:WindowsassemblyGAC_MSILSystem.Runtime.Remoting2.0.0.0__b77a5c561934e089System.Runtime.Remoting.dll

    LoadedModule[61]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ServiceCommon.dll

    LoadedModule[62]=C:WindowsWinSxSamd64_microsoft.vc90.crt_1fc8b3b9a1e18e3b_9.0.30729.6161_none_08e61857a83bc251MSVCR90.dll

    LoadedModule[63]=C:Windowssystem32Secur32.dll

    LoadedModule[64]=C:Windowssystem32SSPICLI.DLL

    LoadedModule[65]=C:Program FilesSystem Center Operations Manager 2007enMicrosoft.Mom.ConfigService.resources.dll

    LoadedModule[66]=C:WindowsassemblyGAC_MSILMicrosoft.EnterpriseManagement.OperationsManager.Common6.0.4900.0__31bf3856ad364e35Microsoft.EnterpriseManagement.OperationsManager.Common.dll

    LoadedModule[67]=C:Program FilesSystem Center Operations Manager 2007MOMBIDldr.dll

    LoadedModule[68]=C:WindowsassemblyGAC_64System.Transactions2.0.0.0__b77a5c561934e089System.Transactions.dll

    LoadedModule[69]=C:WindowsassemblyGAC_64System.EnterpriseServices2.0.0.0__b03f5f7f11d50a3aSystem.EnterpriseServices.dll

    LoadedModule[70]=C:Windowssystem32RpcRtRemote.dll

    LoadedModule[71]=C:Windowssystem32security.dll

    LoadedModule[72]=C:Windowssystem32credssp.dll

    LoadedModule[73]=C:Windowssystem32schannel.DLL

    LoadedModule[74]=C:Windowssystem32kerberos.DLL

    LoadedModule[75]=C:Windowssystem32cryptdll.dll

    LoadedModule[76]=C:Windowssystem32msv1_0.DLL

    LoadedModule[77]=C:Windowssystem32ntdsapi.dll

    LoadedModule[78]=C:Windowssystem32netapi32.dll

    LoadedModule[79]=C:Windowssystem32netutils.dll

    LoadedModule[80]=C:Windowssystem32srvcli.dll

    LoadedModule[81]=C:Windowssystem32wkscli.dll

    LoadedModule[82]=C:Windowssystem32LOGONCLI.DLL

    LoadedModule[83]=C:Windowssystem32mswsock.dll

    LoadedModule[84]=C:WindowsSystem32wshtcpip.dll

    LoadedModule[85]=C:WindowsSystem32wship6.dll

    LoadedModule[86]=C:Windowssystem32DNSAPI.dll

    LoadedModule[87]=C:Windowssystem32IPHLPAPI.DLL

    LoadedModule[88]=C:Windowssystem32WINNSI.DLL

    LoadedModule[89]=C:Windowssystem32rasadhlp.dll

    LoadedModule[90]=C:WindowsSystem32fwpuclnt.dll

    LoadedModule[91]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.Modules.DataTypes.dll

    LoadedModule[92]=C:Program FilesSystem Center Operations Manager 2007Microsoft.EnterpriseManagement.HealthService.dll

    LoadedModule[93]=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.DiscoveryDatabaseAccess.dll

    LoadedModule[94]=C:WindowsMicrosoft.NETFramework64v2.0.50727diasymreader.dll

    LoadedModule[95]=C:Windowssystem32apphelp.dll

    FriendlyEventName=Stopped working

    ConsentKey=CLR20r3

    AppName=Operations Manager Configuration Service

    AppPath=C:Program FilesSystem Center Operations Manager 2007Microsoft.Mom.ConfigServiceHost.exe

    ReportDescription=Stopped working

    Ugh, I may have to reinstall and float at CU4

  52. Peter says:

    Thanxs Kevin for your fast response!

    Best regards,

    PEter

  53. techexp says:

    thanks kevin for your great efforts.

    i recently upgraded scom 2007 sp1 to R2 and it went successfully without any issue. but when applying cu5 it's taking very long time to start(as discussed by u) and after let's say 2 or 2 and half hours i am getting error that "install server didn't respond" or "windows installer error". i have 8 cpus and 16 gb of memory, x64.

    please advice. thanks

  54. Steve IAnson says:

    Hi Kevin,

    Thanks very much for your efforts.

    We discovered an issue which I thought I should share when upgrading from CU4 to CU5: The MP Microsoft.SystemCenter.Library was not updated and remained at version .61 (CU4).

    Looking at the SQL query which does the update (CU5_Database.sql), it's checking against the wrong version: If you are upgrading from CU3 or below it will be updated fine but if you're already at CU4, the MP won't be updated. Guessing they forgot to change the version number for this release.

    After discovering this, we downloaded and imported the updated MP which has been released for use with the authoring console.

    The MP can be found here:

    download.microsoft.com/…/System%20Center%20Library%20Monitoring%20Pack%20for%20OpsMgr%202007%20R2.msi

    Relevant SQL code below

    SET @compare = dbo.fn_VersionCompare (@ver, '6.1.7221.50')

    IF( @compare = -1)

    .

    .

    .

    <ManagementPack ContentReadable="true" xmlns:xsd="http://www.w3.org/…/XMLSchema&quot; xmlns:xsl="http://www.w3.org/…/Transform"&gt;

     <Manifest>

       <Identity>

         <ID>Microsoft.SystemCenter.Library</ID>

         <Version>6.1.7221.81</Version>

       </Identity>

    .

    .

    Best Regards

    Steve

  55. techexp says:

    thanks kevin for your quick reply.

    i am running it on win 2008 enterprise SP2. i tried enabling verbose logging and it gives following output.

    === Verbose logging started: 10/3/2011  10:40:59  Build type: SHIP UNICODE 4.05.6002.00  Calling process: C:Windowssystem32msiexec.exe ===

    MSI (c) (0C:7C) [10:40:59:562]: Resetting cached policy values

    MSI (c) (0C:7C) [10:40:59:562]: Machine policy value 'Debug' is 0

    MSI (c) (0C:7C) [10:40:59:562]: ******* RunEngine:

              ******* Product: SystemCenterOperationsManager2007-R2CU5-KB2495674-X86-X64-IA64-ENU.MSI

              ******* Action:

              ******* CommandLine: **********

    MSI (c) (0C:7C) [10:44:53:016]: Machine policy value 'DisableUserInstalls' is 0

    MSI (c) (0C:7C) [11:02:10:544]: SOFTWARE RESTRICTION POLICY: Verifying package –> 'C:UserssaneesDesktopSCOM CU5SystemCenterOperationsManager2007-R2CU5-KB2495674-X86-X64-IA64-ENU.MSI' against software restriction policy

    MSI (c) (0C:7C) [11:02:10:544]: SOFTWARE RESTRICTION POLICY: C:UserssaneesDesktopSCOM CU5SystemCenterOperationsManager2007-R2CU5-KB2495674-X86-X64-IA64-ENU.MSI has a digital signature

    MSI (c) (0C:1C) [11:27:45:480]: RunEngine wait timed out

    Install server not responding

    MSI (c) (0C:1C) [11:27:45:608]: Font created.  Charset: Req=0, Ret=0, Font: Req=MS Shell Dlg, Ret=MS Shell Dlg

    MSI (c) (0C:1C) [11:31:23:237]: fFatalExit=true

    === Verbose logging stopped: 10/3/2011  11:31:23 ===

    thanks

  56. Jarrad says:

    Thanks Kevin for the answer. Jarrad

  57. Kitaab says:

    We have our ACS collector on the RMS which i Updated with CU5 is there any thing we need to do install ACS Update separately and if yes , how

  58. cca1 says:

    Great Blog, truly a good resource. We are having an issue since CU5, that adding a notification address causes the wizard to just hang with the spinning circle cursor.

    This is on Add or Edit of an address.

    Any ideas?

  59. Hi Kevin:  When running the agent update, my print servers threw a service down alert for the Print Spooler – "Alert: Print Spooler service terminated – 7031". Have you seen this? Of course I got the Teams attention with a bunch of alerts.

    Also, for the Web.Config file, do you have the KB #? Saw the earlier post from Jeffery on the multiple locations. Want to make sure I get it correct.

    Thanks; Bob

  60. Kitaab says:

    Dear kevin,

    As my ACS server is installed on the RMS , i updated my RMS with CU5 , does my ACS component get updated as well ,

    In the post step 10 you have mentioned to run the ACS update, Problem is when i do that the installed gives me option to remove or repair , but doesnt show the Splash screen where i could choose Run ACS update.

  61. Kitaab says:

    There is a specific shortcut for "Launch Cumulative Update Setup" in the Instal directory for the hotfix. i clicked on it and it gave me the option to c update ACS. Thanks for your time Kevin

  62. Hi Kevin,

    I have some questions:

    1. Do you update Root management server, update DB with script, import packs and then restart or you update Root management server, restart and than update DB with script and import packs?

    2. Do you update RMS restart check server health and than update other MS servers or do you update RMS, update other MS servers and than restart RMS and other MS servers?

  63. Hi Kevin,

    I am trying to update first my SCOM console just to test if that activity will be successful. I run the following command:

    SetupUpdateOM.exe /x86msp:KB2495674-x86.msp /amd64msp:KB2495674-x64.msp /ia64msp:KB2495674-ia64.msp /x86locmsp:KB2495674-x86-ENU.msp /amd64locmsp:KB2495674-x64-ENU.msp /ia64locmsp:KB2495674-ia64-ENU.msp /noreboot

    When I run it I get the splash screen and I press Run Server Update.

    The installer fails and says that it was interrupted. Form the install log I get this error:

    === Logging stopped: 1/4/2012  10:15:10 ===

    MSI (c) (FC:88) [10:15:10:588]: Product: System Center Operations Manager 2007 R2 – Update 'System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674)' could not be installed. Error code 1603. Additional information is available in the log file C:DOCUME~1393987LOCALS~1Temp2KB2495674-x64_1.log.

    MSI (c) (FC:88) [10:15:10:588]: Note: 1: 1729

    MSI (c) (FC:88) [10:15:10:588]: Product: System Center Operations Manager 2007 R2 — Configuration failed.

    MSI (c) (FC:88) [10:15:10:588]: Attempting to delete file C:DOCUME~1393987LOCALS~1Temp211367e9f.msp

    MSI (c) (FC:88) [10:15:10:588]: Unable to delete the file. LastError = 32

    MSI (c) (FC:88) [10:15:10:588]: Grabbed execution mutex.

    MSI (c) (FC:88) [10:15:10:588]: Cleaning up uninstalled install packages, if any exist

    MSI (c) (FC:88) [10:15:10:588]: MainEngineThread is returning 1603

    === Verbose logging stopped: 1/4/2012  10:15:10 ===

    Server is Windows 2003 R2 SP2

    Do you have any idea what is the problem or how can I troubleshoot?

  64. I've tried with /silent switch at the end and worked without problem. I waited a while and than started the console and now it is .81 version.

  65. Deepesh says:

    Hi Kevin, I have upgraded SCOM server to CU5 and upgrading agents now. But some agents are throwing error during installation:

    "Product: System Center Operations Manager 2007 R2 Agent – Update 'System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674)' could not be installed. Error code 1603."

    How can we fix the issue?

    Thanks,

    Deepesh

  66. Chris says:

    How can I verify that the cross platform agents are at the CU5 version? The agent Version Number in the monitoring view (Unix/Linux Servers) still shows 1.0.4-265. Shouldn't this also be a 277 version?

  67. Ingode says:

    Will it work on Windows Server 2003? In the download area it says Windows Server 2008 is required.

  68. angel says:

    Hi Kevin,

    We have updated to version CU5 Scom (6.1.7221.81.) And their agents, we have checked the version of dll's and we have verified that is correct, (6.1.7221.81.).

    Our question is whether the agent version is to be changed on the console,  now displays the version (6.1.7221.0) Thanks in advance.

    A greeting.

  69. Gregg Hamby says:

    I apologize if this has been covered elsewhere but I cannot seem to get a manual agent update to CU5 to work with the published instructions. Running the setupupdateOM with the appropriate xsp and locmap parameters simply returns the error "The patch package could not be opened.  Contact the application vendor to verify that this is a valid Windows Installer patch package….

    This is my command line (I removed the /silent):

    SetupUpdateOM.exe /x86msp:KB2495674-x86-Agent.msp /amd64msp:KB2495674-x64-Agent.msp /ia64msp:KB2495674-ia64-Agent.msp /x86locmsp:KB2495674-x86-ENU-Agent.msp /amd64locmsp:KB2495674-x64-ENU-Agent.msp /ia64locmsp:KB2495674-ia64-ENU-Agent.msp /UpdateAgent /noreboot

    After a lot of playing around trying to specify paths or move the msp files into different directories I finally simply went into my CU5Agent directory and ran msiexec /update KB2495674-x64-Agent.msp and it ran perfectly?

    Any idea what the deal is with SetupUpdateOM?

    Thanks.

  70. Timeout? says:

    Hello,

    I am running CU5 on my test server and I am getting a warning "Warning 25362. Failed to start OMCFG service. Setup will proceed, please examine your eventlog.

    Log Name:      System

    Source:        Service Control Manager

    Date:          2/24/2012 1:47:20 PM

    Event ID:      7009

    Task Category: None

    Level:         Error

    Keywords:      Classic

    User:          N/A

    Computer:      VRTSCOMO1.ad.medctr.ucla.edu

    Description:

    A timeout was reached (30000 milliseconds) while waiting for the System Center Management Configuration service to connect.

    Which key do I need to chnage?

    Thanks,

    DOm

  71. Workaround #1 increase says:

    Should I repair the installation or better remove and install a fresh one?

    Thanks,

    Dom

  72. sql FAILING... says:

    I did a fresh installation and it goes to the loop 3 times… then starting the 1st sql it seems soemthing is missing…

    The module 'p_RemoveEntityFromDiscoverySourceScope' depends on the missing object 'dbo.p_TypedManagedEntityDelete'. The module will still be created; however, it cannot run successfully until the object exists.

    Msg 208, Level 16, State 6, Procedure p_MakeViewCreationText, Line 176

    Invalid object name 'dbo.p_MakeViewCreationText'.

    The module 'p_InstallTypesAndReltypes' depends on the missing object 'dbo.p_TypeDeletePermanent'. The module will still be created; however, it cannot run ,,,

    The module 'p_BaseManagedEntityInsert' depends on the missing object 'dbo.p_BaseManagedEntityUpdateDisplayName'. The module will still be created; however, it cannot run successfully until the object exists.

    Msg 208, Level 16, State 1, Line 9

    Invalid object name 'dbo.DerivedManagedTypes'.

    Msg 208, Level 16, State 1, Line 5

    Invalid object name 'ManagementPack'.

  73. Dominique says:

    Hello,

    I installed CU5 on my test server and it worked like a charm.

    I am trying on production now and it fails…

    Product: System Center Operations Manager 2007 R2 – Update 'System Center Operations Manager 2007 R2 Cumulative Update 5 (KB2495674)' could not be installed. Error code 1603. Additional information is available in the log file C:UsersDOMINI~1AppDataLocalTempKB2495674-x64_0.log.

    Information 1603.The file G:Program FilesSystem Center Operations Manager 2007HealthServiceRuntime.dll is being held in use by the following process: Name: MonitoringHost, Id: 5556, Window Title: '(not determined yet)'.

    Information 1603.The file G:Program FilesSystem Center Operations Manager 2007MonitoringHost.exe is being held in use by the following process: Name: MonitoringHost, Id: 5556, Window Title: '(not determined yet)'.

    Information 1603.The file G:Program FilesSystem Center Operations Manager 2007MOMModules.dll is being held in use by the following process: Name: MonitoringHost, Id: 5556, Window Title: '(not determined yet)'.

    Information 1603.The file G:Program FilesSystem Center Operations Manager 2007MomIISModules.dll is being held in use by the following process: Name: MonitoringHost, Id: 5556, Window Title: '(not determined yet)'.

    MSI (s) (FC:94) [13:36:18:960]: 1 application(s) had been reported to have files in use.

    MSI (c) (FC:F8) [13:36:18:960]: File In Use: -MonitoringHost- Window could not be found. Process ID: 5556

    MSI (c) (FC:F8) [13:36:18:961]: No window with title could be found for FilesInUse

    Did I miss a step? Any services to stop? I have no connector…

    I have others MS and ACS and DW servers.

    Thanks,

    DOm

  74. Toby S says:

    CU5 introduces updating the Agent by simply running two MSP files extracted from the Hotfix installation directory.  Details are in the KB 2495674.  It is no longer necessary to run SetupOM.EXE.

    I thought this was a BIG improvement worth mentioning.

    Thanks for your excellent blogs Kevin.

    Toby

  75. Dominique says:

    Finally CU5 installationis done on the RMS amd MS as it was most likely an issue with the account to be used having some permissions but not the three of them wide spred.

    Thanks Kevin,

    DOminique

  76. Dominique says:

    Hello,

    Do we have the equivalent of the view "Agent per Version" for Unix/Linux to verify the CU5 has been applied?

    Thanks,m

    DOm

  77. eizhak9 says:

    i dont have "Operations Manager data warehouse" what can i do ? not import the MP are i dont need to have Operations Manager data warehouse ?

    eizhak9@gmail.com

    please help me

  78. Bob Hyatt says:

    Hi Kevin,

    I just took over SCOM 2k7 R2 from previous admin.  Is there a way to determine what cu of the current scom?  I saw the DLL file version at 6.1.7221.0.  Is it possible that I can apply cu 5 to this environment?

    Thanks,

    Bob Bale

  79. Divad says:

    Kevin can I upgrade from   SCOM 2007 R2     6.1.7221.0 RTM to the CU5 ? or I need to upgrade one by one.

    please let me know thanks is in a Dev environment  

  80. Guido5 says:

    Since we do not have R2 yet in place can we also upgrade from SP1  to R2 CU5 ? Thanks in advance!