ISA 2004 installation may fail on SBS 2003 and the server would reboot unexpectedly

Ok, now this is an interesting one. So hold on tight and listen (or read) carefully :)

Today, I ran into an ISA 2004 installation issue but this was a bit different from others. So here it goes...

When you try to install ISA 2004 on SBS 2003 from the Premium Technologies disk, the setup wizard would launch and would run for a minute or so and then you would see a message that the server is shutting down without any user intervention required. When the server comes back, you would notice that ISA 2004 is not installed and there is no MSSQL$MSFW instance installed either.

So from where do we start the troubleshooting?

There are 4 log files created when you install ISA 2004 and they are as follows with their default location. The xxx denotes some random numbers.

ISAFWSV_xxx.log (C:\Windows\Temp)

ISAWRAP_xxx.log (C:\Windows\Temp)

ISAMSDE_xxx.log (C:\Windows\Temp)

sbsisa2k4setuplog.txt (C:\Program Files\Microsoft Windows Small Business Server\Support)

The log files may contain entries that are similar to the following

********************sbsisa2k4setuplog.txt********************

SBSISA2K4SETUP: Preparing ISA2k4 install cmd line returned OK

SBSISA2K4SETUP: Launching ISA2k4 setup: D:\ISA2004\FPC\setup.exe

SBSISA2K4SETUP: Command Line: D:\ISA2004\FPC\setup.exe /v"/qn FULLPATHANSWERFILE=\"C:\Program Files\Microsoft Windows Small Business Server\Support\Premium\ISA2k4und2007_10_04_08_11_06.ini\""

SBSISA2K4SETUP: CreateProcess returned OK

SBSISA2K4SETUP: ISA2k4 setup completed before post config

SBSISA2K4SETUP: *** WaitingForMultipleObjects returned ERROR 0x80004005

SBSISA2K4SETUP: *** LaunchISA2k4NativeSetup returned ERROR 0x80004005

SBSISA2K4SETUP: *** Running ISA2k4 setup unattended returned ERROR 0x80004005

SBSISA2K4SETUP: Entering IsISA2k4Installed

IsISA2k4Installed returned FALSE

SBSISA2K4SETUP: ISA2k4 is NOT installed

SBSISA2K4SETUP: Setting RRAS start type to automatic returned OK

*************************************************************

***********************ISAWRAP_152.log***********************

Installer activated, command-line='/v"/qn FULLPATHANSWERFILE=\"C:\Program Files\Microsoft Windows Small Business Server\Support\Premium\ISA2k4und2007_10_04_08_11_06.ini\""'

Running setup wrapper in quiet mode.

Activating firewall installation program

Reboot required to complete operation

Process completed successfully

Firewall installation ended successfully

Creating an entry in ARP

Attempting to install MSDE

Activating MSDE installation

Deleting previous MSDE installation directory <C:\Program Files\microsoft sql server\MSSQL$MSFW>

Setup failed. Error returned: 0x643

MSDE Installation failed, hr=80070643

Performing rollback (uninstall) of firewall

Activating setup cmdline='C:\WINDOWS\system32\msiexec.exe /qn /x {0AC95D97-1B75-4AC7-B061- F21E379FF809} REBOOT=ReallySuppress WRAPPER=1 /Lvoicewarmup+ C:\WINDOWS\TEMP\ISAFWSV_152.log '

Process completed successfully

Installation completed successfully

ShowSecurePage: Not showing on unattended

***************************************************************

***********************ISAMSDE_152.log*************************

Action start 08:14:00: SetPropSQLMSDEInstalled.2D02443E_7002_4C0B_ABC9_EAB2C064397B.

SOFTWARE\Microsoft\Microsoft SQL Server Setup.{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}

TempFolder is C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}Loading extended custom action library C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlcax.dll

Error 127 loading library sqlcax.dll

Action ended 08:14:01: SetPropSQLMSDEInstalled.2D02443E_7002_4C0B_ABC9_EAB2C064397B. Return value 3.

Action ended 08:14:01: INSTALL. Return value 3.

Property(S): OriginalDatabase = C:\Program Files\Microsoft ISA Server\MSDE\Setup\SqlRun04.msi

Property(S): UILevel = 2

Property(S): ACTION = INSTALL

MSI (s) (78:80) [08:14:01:167]: Note: 1: 1708

MSI (s) (78:80) [08:14:01:167]: Product: Microsoft SQL Server Desktop Engine -- Installation operation failed.

***************************************************************

As we can see from the ISA logs that the setup failed at the point of installing Microsoft SQL Server Desktop Engine (also called MSDE). So to further isolate the problem we tried installing a standalone instance of MSDE but that too failed with the error listed below.

You can use the following link to download the MSDE 2000 installer package.

https://www.microsoft.com/downloads/details.aspx?familyid=413744D1-A0BC-479F-BAFA-E4B278EB9147&displaylang=en

To know more about MSDE 2000 please go thru the following link.

https://download.microsoft.com/download/d/5/4/d5402c33-65de-4464-9d82-d1de2971d9db/ReadmeMSDE2000A.htm

The command used to install the stand alone MSDE instance is as follows:

setup /i "C:\msderela\setup\sqlrun03.msi" instancename="MSDE05" SAPWD="P@ssword1!" securitymode=sql DISABLEROLLBACK=1 /L*v C:\msderela\msde5.log

And here is the snippet from the log file msde5.log

***************************msde5.log***************************

MSI (s) (88:D8) [15:25:03:953]: Hello, I'm your 32bit Impersonated custom action server.

SOFTWARE\Microsoft\Microsoft SQL Server Setup.{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}

Creating CA Temp Directory : C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}

Streamed setupex.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\setupex.dll

Streamed sqdedev.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqdedev.dll

Streamed sqlsut.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlsut.dll

Streamed sqlunirl.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlunirl.dll

Streamed sqlresld.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlresld.dll

Streamed sqlcaxrll.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlcax.rll

Streamed sqlstp.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlstp.dll

Streamed sqlstprll.2D02443E_7002_4C0B_ABC9_EAB2C064397B to C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlstp.rll

Streamed sqlcax.2D02443E_7002_4C0B_ABC9_EAB2C064397B to \{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlcax.dll

Action ended 15:25:04: StreamSupportFiles.2D02443E_7002_4C0B_ABC9_EAB2C064397B. Return value 1.

MSI (s) (88:A4) [15:25:04:172]: Doing action:

SetPropSQLMSDEInstalled.2D02443E_7002_4C0B_ABC9_EAB2C064397B

Action start 15:25:04: SetPropSQLMSDEInstalled.2D02443E_7002_4C0B_ABC9_EAB2C064397B.

MSI (s) (88:D8) [15:25:04:172]: Invoking remote custom action. DLL: C:\WINDOWS\Installer\MSI5B3.tmp,

Entrypoint: SetPropSQLMSDEInstalled

SOFTWARE\Microsoft\Microsoft SQL Server Setup.{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}

TempFolder is C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}Loading extended custom action library C:\DOCUME~1\Admin\LOCALS~1\Temp\{C2736CA7-76E1-4D0C-B590-483A7FFD18DA}\sqlcax.dll

Error 127 loading library sqlcax.dll

Action ended 15:25:04: SetPropSQLMSDEInstalled.2D02443E_7002_4C0B_ABC9_EAB2C064397B. Return value 3.

Action ended 15:25:04: INSTALL. Return value 3.

***************************************************************

So now we know that it’s an issue with MSDE issue and not an ISA 2004 problem. The following KB talks about the same issue.

https://support.microsoft.com/kb/299351
BUG: MSDE Installation Fails on Systems That Have SQL Server 2000 Service Pack 1 or 2 Installed

So we went ahead and renamed the files as mentioned in the above KB but it didn’t help. Eventually, with the help of Live debugging we discovered that the files mentioned in the KB also existed under C:\Windows\System32. We renamed those files as well, ran the MSDE installation and it completed successfully. Went ahead and installed ISA 2004 and it worked like a charm.

PS: Don’t forget to rename those files back to their original name, as they may still be used by other applications