The big difficulty of implementing a BizTalk infrastructure in high availability on Microsoft Azure, has always been about both SQL Server and Distributed Transaction Coordinator (MSDTC).

In this article, I will show the results of some tests with the use of a SAN less solution that enables the creation of SQL Server in a failover cluster configuration.

In this context, we can identify two scenarios of HA. The first involves a single cluster where are running both SQL Server and BizTalk Server services.

 

 

The second one consist of a cluster where are running SQL Server and SSO services and two additional servers for BizTalk server services.

 

 

The first scenario is undoubtedly easier to implement, especially because it requires very little configuration on the network layer. However, the second scenario is certainly the most interesting, for that reason will be what I will illustrate.

This document contains instructions for setting up the Windows Server 2012 R2 test lab by deploying five server computers running Windows Server 2012 R2 as Azure virtual machines in order to implement high availability for a Microsoft BizTalk infrastructure on the cloud.

The Windows Server 2012 R2 configuration in Azure test lab consists of the subnet in a cloud-only Azure Virtual Network named BizTalkLab that simulates a simplified intranet.

 

 

Because Microsoft Azure does not have a clustered storage option, I will use the third party solution called DataKeeper Cluster Edition for cluster storage.

To realize this post I have collected the official documentation and several other posts that I have reported in the following.

 

Step 1: Create the Azure Virtual Network

First, you create the BizTalkLab Azure Virtual Network that will host the BizTalkNet subnet of the base configuration. Then, you create an Azure cloud service. Lastly, you configure a storage account that will contain the disks for your virtual machines and extra data disks.

 

Create a virtual network

1. In the task bar of the Azure Management Portal, click NEW > NETWORK SERVICES > VIRTUAL NETWORK > CUSTOM CREATE.
   
2. On the Virtual Network Details page, type BtLabNet or the name of your choice in NAME.
   
3. In LOCATION, select the appropriate region.
   
4. Click the Next arrow.
   
5. On the DNS Servers and VPN Connectivity page, in DNS servers, type BTLABDC1 in Select or enter name, type 10.0.0.4 in IP address, and then click the Next arrow.
   
6. On the Virtual Network Address Spaces page, in Subnets, click Subnet-1 and replace the name with BtLabSubnet.
   
7. In the STARTING IP column for the BtLabSubnet subnet, select 10.0.0.4.
   
8. In the CIDR (ADDRESS COUNT) column for the BtLabSubnet subnet, click /24 (256).
   
9. On the Virtual Network Address Spaces page, click add Subnet
   
10. Specify BtLabSubnet2 as subnet name
    
11. In the STARTING IP column for the BtLabSubnet2 subnet, select 10.0.1.0.
    
12. In the CIDR (ADDRESS COUNT) column for the BtLabSubnet2 subnet, click /24 (256).
    
13. Click the Complete icon. Wait until the virtual network is created before continuing.
    

 

 

The second subnet is not essential, but can be used to separate the network traffic related to the replication of the disks rather than internal communications of the cluster service.

 

Create a new cloud service for the BtLabNet virtual network

 

1. In the task bar of the Azure Management Portal, click NEW > COMPUTE > CLOUD SERVICE > QUICK CREATE.
   
2. In URL, type a unique name. For example, you could name it BtLabNet-UniqueSequence, in which UniqueSequence is an abbreviation of your organization.
   
3. In REGION OR AFFINITY GROUP, select the same region as your BtLabNet virtual network.
   

 

 

1. Click the CREATE CLOUD SERVICE complete icon. Wait until the cloud service is created before continuing.
   

 

Create a new storage account

1. In the task bar of the Azure Management Portal, click NEW > DATA SERVICES > STORAGE > QUICK CREATE.
   
2. In URL, type a unique name.
   
3. In REGION OR AFFINITY GROUP, select the same region as your BtLabNet virtual network.
   

 

 

1. Click the CREATE STORAGE ACCOUNT complete icon. Wait until the storage account is created before continuing.
   

 

Step 2: Configure Domain and Domain Controller

 

Following the procedure to create BTLABDC1 server.

BTLABDC1 provides the following services:

• A domain controller for the btlab.pellitterisbiztalkblog.com Active Directory Domain Services (AD DS) domain.
  
• A DNS server for the virtual machines of the BtLabNet virtual network.
  

 

BTLABDC1 configuration consists of the following:

• Create an Azure Virtual Machine for BTLABDC1.
  
• Add a data disk.
  
• Configure BTLABDC1 as a domain controller and DNS server.
  
• Create a user account in Active Directory.
  

 

Create an Azure Virtual Machine

 

1. In the task bar of the Azure Management Portal, click NEW > COMPUTE > VIRTUAL MACHINE > FROM GALLERY.
   
2. On the Choose an Image page, click Windows Server 2012 R2 Datacenter, and then click the Next arrow.
   
3. On the Virtual machine configuration page:
   

• In VIRTUAL MACHINE NAME, type BTLABDC1.
  
• Select a size.
  
• In NEW USER NAME, type the name of a local administrator account. You will use this account when initially connecting and as an alternate set of credentials when BTLABDC1 becomes a domain controller. Choose a name that is not easy to guess.
  
• In NEW PASSWORD and CONFIRM, type a strong password for the local administrator account.
  
• Record the local administrator account name and password in a secured location.
  

1. Click the Next arrow.
   
2. On the second Virtual machine configuration page:
   

• In CLOUD SERVICE, select the cloud service that you created in “Step 1: Create the Azure Virtual Network.”
  
• In REGION/AFFINITY GROUP/VIRTUAL NETWORK, select BtLabNet.
  
• In STORAGE ACCOUNT, select the storage account that you created in “Step 1: Create the Azure Virtual Network.”
  
• In AVAILABILITY SET specify Create an availability set and specify its name.
  
• In ENDPOINTS, in the PowerShell row, delete the default port number in the PUBLIC PORT column.
  

 

 

1. Click the Next arrow.
   
2. On the third Virtual machine configuration page, click the Complete icon. Wait until Azure creates the virtual machine.
   
3. On the virtual machines page of the Azure Management Portal, click Running in the STATUS column for the BTLABDC1 virtual machine.
   
4. On the command bar, click Attach, and then select Attach Empty Disk. The Attach Empty Disk dialog box appears. The Storage Location and File Name boxes contain automatically generated names that do not need to be altered.
   
5. In the Size box, type 20.
   
6. Leave the Host Cache Preference set to the default value of NONE.
   
7. Click the Complete icon to attach the empty data disk. Wait until the status is Running before continuing (a few minutes).
   
8. In the task bar, click CONNECT.
   
9. When prompted to open BTLABDC1.rdp, click Open.
   
10. When prompted with a Remote Desktop Connection message box, click Connect.
    
11. When prompted for credentials, use the following:
    

• Name: BTLABDC1\[Local administrator account name] (from step 3)
  
• Password: [Local administrator account password] (from step 3)
  

1. When prompted with a Remote Desktop Connection message box referring to certificates, click Yes.
   

 

Add a data disk

Add an extra data disk as a new volume with the drive letter F:.

1. In the left pane of Server Manager, click File and Storage Services, and then click Disks.
   
2. In the contents pane, in the DISKS group, click disk 2 (with the Partition set to Unknown).
   
3. Click Tasks, and then click New Volume.
   
4. On the Before you begin page of the New Volume Wizard, click Next.
   
5. On the Select the server and disk, click Disk 2, and then click Next. When prompted, click OK.
   
6. On the Specify the size of the volume page, click Next.
   
7. On the Assign to a drive letter or folder page, click Next.
   
8. On the Select file system settings page, click Next.
   
9. On the Confirm selections page, click Create.
   
10. When complete, click Close.
    

 

Configure BTLABDC1 as a domain controller and DNS server

To configure BTLABDC1 as a domain controller and DNS server for the corp.pellitterisbiztalkblog.com domain, run the following commands at a Windows PowerShell command prompt:

 

 

Note that you will be prompted to supply a Directory Services Restore Mode (DSRM) password and to restart BTLABDC1.

 

High Availability Considerations

This document shows an installation of a test environment. In a production environment, to ensure high availability of services you need to add a second domain controller.

 

Prepare User and Groups

 

Sample Script

 

 

Step 3: Configure two SQL Server nodes

 

To create SQL Server nodes with two NICs you have to use PowerShell interface. To do that, download the latest version of the azure SDK available at the following link http://azure.microsoft.com/en-us/documentation/articles/install-configure-powershell/

 

Run the following commands to create the first SQL Server node:

 

 

Then follow the step below:

 

1. On the virtual machines page of the Azure Management Portal, click Running in the STATUS column for the BTLABSQL1 virtual machine.
   
2. On the command bar, click Attach, and then select Attach Empty Disk. The Attach Empty Disk dialog box appears. The Storage Location and File Name boxes contain automatically generated names that do not need to be altered.
   
3. In the Size box, type 10.
   
4. Leave the Host Cache Preference set to the default value of NONE.
   
5. Click the Complete icon to attach the empty data disk. Wait until the status is Running before continuing (a few minutes).
   
6. In the task bar, click CONNECT.
   
7. When prompted to open BTLABDC1.rdp, click Open.
   
8. When prompted with a Remote Desktop Connection message box, click Connect.
   
9. When prompted for credentials, use the following:
   

• Name: BTLABSQL1\[Local administrator account name]
  
• Password: [Local administrator account password]
  

1. When prompted with a Remote Desktop Connection message box referring to certificates, click Yes.
   

 

Add a data disk

 

Add an extra data disk as a new volume with the drive letter F:.

1. In the left pane of Server Manager, click File and Storage Services, and then click Disks.
   
2. In the contents pane, in the DISKS group, click disk 2 (with the Partition set to Unknown).
   
3. Click Tasks, and then click New Volume.
   
4. On the Before you begin page of the New Volume Wizard, click Next.
   
5. On the Select the server and disk, click Disk 2, and then click Next. When prompted, click OK.
   
6. On the Specify the size of the volume page, click Next.
   
7. On the Assign to a drive letter or folder page, click Next.
   
8. On the Select file system settings page, click Next.
   
9. On the Confirm selections page, click Create.
   
10. When complete, click Close.
    

 

Configuring Network

Assign static IP to the network interfaces and disable Firewall or configure it to open SQL Server TCP port, SSO TCP port and RPC (for both SSO and MSDTC services).

 

Join SQL Server node to Active Directory Domain

 

1. In the left pane of Server Manager, click Local Server.
   
2. In the contents pane, in the PROPERTIES group, click WORKGROUP and then Change
   
3. Select Domain and specify btlab.pellitterisbiztalkblog.com
   
4. Specify the administrator credentials and confirm.
   
5. Click OK on Welcome to domain dialog box and then restart the machine.
   

 

Configuring second node

 

Repeat this step for the second SQL Server node.

 

Step 4: Create Cluster

 

To install the Failover Clustering feature

 

1. Start Server Manager.
   
2. On the Manage menu, click Add Roles and Features.
   
3. On the Before you begin page, click Next.
   
4. On the Select installation type page, click Role-based or feature-based installation, and then click Next.
   
5. On the Select destination server page, click the server where you want to install the feature, and then click Next.
   
6. On the Select server roles page, click Next.
   
7. On the Select features page, select the Failover Clustering check box.
   
8. To install the failover cluster management tools, click Add Features, and then click Next.
   
9. On the Confirm installation selections page, click Install.
   
10. When the installation is completed, click Close.
    
11. Repeat this procedure on every server that you want to add as a failover cluster node.
    

 

To run cluster validation tests

 

1. On a computer that has the Failover Cluster Management Tools installed from the Remote Server Administration Tools, or on a server where you installed the Failover Clustering feature, start Failover Cluster Manager. To do this on a server, start Server Manager, and then on the Tools menu, click Failover Cluster Manager.
   
2. In the Failover Cluster Manager pane, under Management, click Validate Configuration.
   
3. On the Before You Begin page, click Next.
   
4. On the Select Servers or a Cluster page, in the Enter name box, enter the NetBIOS name or the fully qualified domain name of a server that you plan to add as a failover cluster node, and then click Add. Repeat this step for each server that you want to add. To add multiple servers at the same time, separate the names by a comma or by a semicolon. For example, enter the names in the format server1.contoso.com, server2.contoso.com. When you are finished, click Next.
   
5. On the Testing Options page, click Run all tests (recommended), and then click Next.
   
6. On the Confirmation page, click Next.
   

 

The Validating page displays the status of the running tests.

 

1. The test should succeed with some warnings. Deselect Create the cluster now using the validated nodes and then click Finish.
   

 

To create the failover cluster

 

1. Start Server Manager.
   
2. On the Tools menu, click Failover Cluster Manager.
   
3. In the Failover Cluster Manager pane, under Management, click Create Cluster.
   

 

The Create Cluster Wizard opens.

 

1. On the Before You Begin page, click Next.
   
2. In the Select Servers page appears, in the Enter name box, enter the NetBIOS name or the fully qualified domain name of the first on SQL Server nodes, and then click Add. When you are finished, click Next.
   

 

Note: We will start by creating a single node cluster, this allow you to make the necessary adjustment to the cluster name resource before we add the second node to the cluster.

 

1. Select No, to skip the validation test and then click Next.
   
2. On the Access Point for Administering the Cluster page specify the cluster NetBIOS name and then click Next.
   

 

 

 

1. On the Confirmation page, review the settings and click Next to create the failover cluster.
   
2. On the Summary page, confirm that the failover cluster was successfully created and click Finish.
   

 

Once the cluster wizard creation process completes, you may notice that the cluster name resource fails to go online, this is normal.

If it happens, follow steps 10, 11 and 12, otherwise ignore them.

 

 

1. Right click on IP Address resource and select Properties.
   
2. On IP Address properties page select Static IP Address and specify the higher and of the subnet range.
   

 

 

1. Confirm the change and try to bring on line the resource.
   

 

 

To add second SQL Server node

 

1. On a computer that has the Failover Cluster Management Tools installed from the Remote Server Administration Tools, or on a server where you installed the Failover Clustering feature, start Failover Cluster Manager. To do this on a server, start Server Manager, and then on the Tools menu, click Failover Cluster Manager.
   
2. In the Failover Cluster Manager click Add Node.
   

 

 

1. On the Before You Begin page, click Next.
   
2. In the Select Servers page appears, in the Enter name box, enter the NetBIOS name or the fully qualified domain name of the second SQL Server nodeBTLABSQL2, and then click Add. When you are finished, click Next.
   
3. On the Confirmation page, review the settings and click Next.
   
4. On the Summary page click Finish.
   

 

Create a network file share for witness configuration

 

Connect to BTLABDC1 virtual machine.

1. On the virtual machines page of the Azure Management Portal, click Running in the STATUS column for the BTLABDC1 virtual machine.
   
2. In the task bar, click CONNECT.
   
3. When prompted to open BTLABDC1.rdp, click Open.
   
4. When prompted with a Remote Desktop Connection message box, click Connect.
   
5. When prompted for credentials, use the following:
   

• Name: BTLAB\[Local administrator account name] (from step 3 of the “Create an Azure Virtual Machine for BTLABDC1” procedure)
  
• Password: [Local administrator account password] (from step 3 of the “Create an Azure Virtual Machine for BTLABDC1” procedure)
  

1. When prompted by a Remote Desktop Connection message box referring to certificates, click Yes.
   
2. In the left pane of Server Manager, click File and Storage Services, and then click Shares.
   
3. In the contents pane, in the SHARES group click Tasks, and then click New Share.
   
4. In the New Share Wizard leave the proposed profile and click Next.
   
5. Select Type a custom path and browse for create a folder to share then click Next.
   

 

 

1. Specify a share name and click Next.
   
2. Deselect all settings and Click Next.
   
3. On permission page select Customize permissions.
   
4. Select the principal BTLAB\BTLABCLUSTER$ and provide Modify Permission
   

 

 

Confirm the permission and complete the wizard.

 

Configure cluster quorum

 

On a computer that has the Failover Cluster Management Tools installed from the Remote Server Administration Tools, or on a server where you installed the Failover Clustering feature, start Failover Cluster Manager. To do this on a server, start Server Manager, and then on the Tools menu, click Failover Cluster Manager.

 

1. In the Failover Cluster Manager right click the cluster node, select More Actions and then Configure Cluster Quorum Settings.
   

 

 

1. On the Before You Begin page, click Next.
   
2. Select “Select the quorum witness” and click Next.
   
3. Select Configure a file share witness and click Next
   
4. Specify the share path “\\BTLABDC1\SqlWitness” and click Next
   
5. On the Confirmation page review all settings and click Next
   
6. On the Summary page click Finish
   

 

Step 5: Create Replicated Volume Cluster Resource with DataKeeper Cluster Edition

 

Before starting SIOS setup, you must install the .NET Framework 3.5.

 

To install the .NET Framework 3.5 feature

 

1. Start Server Manager.
   
2. On the Manage menu, click Add Roles and Features.
   
3. On the Before you begin page, click Next.
   
4. On the Select installation type page, click Role-based or feature-based installation, and then click Next.
   
5. On the Select destination server page, click the server where you want to install the feature, and then click Next.
   
6. On the Select server roles page, click Next.
   
7. On the Select features page, select the .NET Framework 3.5 Feature check box and then click Next.
   
8. On the Confirm installation selections page, click Install.
   
9. When the installation is completed, click Close.
   
10. Repeat this procedure on every server that you want to add as a failover cluster node.
    

 

Other Prerequisites

 

1. Create a domain account for DataKeeper service account
   
2. Make this account member of local Administrators account of both SQL Server nodes.
   

 

To install DataKeeper cluster edition

In this lab I used a 14 day trial license that is generally available for testing upon request.

 

 

On the welcome page Click Next

 

 

On the License Agreement click Yes

 

 

Leave the selection and click Next

 

 

Choose the destination and click Next

 

 

Confirm the changes

 

 

Select Domain or Server account and click Next

 

 

Specify the domain service user and click Next

 

 

 

Click on Install License File to choose the License provided with demo setup and click Exit

 

 

Click Finish to confirm the restart.

Repeat the procedure on the second node.

 

After the reboot, connect to the first SQL Server node, run the DataKeeper UI and complete the steps below.

 

 

Click on Connect to Server and specify the first node

 

 

Make same thing with the second node

 

 

Then, create a job specifying name and description.

 

 

If you have prepared a server with two interfaces you can specify the second subnet to implement the disk replica.

 

 

Choose the network interface for the second node

 

 

Then specify Synchronous and click Done

 

 

Confirm to create disk cluster resource

 

 

Then exit. From the Failover Cluster Manager you can see the disk resource.

 

 

Step 6: Install SQL Server 2014

 

Following the screenshot that I used to install SQL Server 2014 cluster nodes.

 

 

 

 

 

 

 

 

 

 

 

 

Repeat the previous steps on the second node. Then follow the step below.

 

 

 

 

 

 

 

 

 

 

 

 

 

To cluster Distributed Transaction Coordinator (MSDTC)

 

From Failover Cluster Manager select SQL Server Role and click Add Resource on the right panel.

 

 

 

 

You can now bring on line DTC cluster resource.

From Administrative Tools, open the Component Services to configure MSDTC cluster resource security settings.

 

 

Step 7: Configure client access

 

Create an Internal Load Balancer

Once the cluster is configured, you will need to create the internal load balancer (ILB) which will be used for all client access. Clients that connect to SQL Server, Enterprise SSO and MSDTC will need to connect to the ILB instead of connecting directly to the cluster IP address.

The following commands can take even a few hours.

 

 

Update the Client Listener

 

Once the internal load balancer is created you will need to run a Powershell script on first SQL node to update the SQL Server Cluster IP address. The script references the Cluster Network name and the IP Resource Name. The pictures below show you were to find both of these names in Failover Cluster Manager.

 

 

 

The script below should be run on one of the cluster nodes. Make sure to launch Powershell ISE using Run as Administrator.

 

 

 

You will need to bring your cluster resource offline once and then bring it online.

 

Configure MSDTC to Use a Specific Port

 

1. Start Component Services MMC, right click My Computer and select Properties
   
2. Select the Default Protocols tab
   
3. Click Properties button
   
4. Click Add
   
5. Type in the port range that is above the port MSDTC will use. In this case, I will use ports 5000-5065.
   

 

 

1. Click OK back to My Computer properties window and click OK
   

 

Note: The number of specified ports for dynamic RPC is not casual but is due to the limitation of maximum number of configurable endpoints of ILB that at this moment is 150. So you can have, 65 dynamic RPC endpoints for the first node, 65 endpoint for the second node and two additional tcp ports endpoint for SQL Server (1433) and RPC (135) for both servers.

 

1. Start Regedt32.exe
   
2. Locate HKEY_LOCAL_MACHINE\Cluster\Resources\{Unique_DTC_ResourceID_GUID}\MSDTCPRIVATE\MSDTC
   
3. Right click the MSDTC key, select New and DWord (32-bit) Value
   
4. Type ServerTcpPort for the key name
   
5. Right click ServerTcpPort key and select Modify
   
6. Change radio button to Decimal and type 5021 in the value data, click OK.
   

 

Note: Leave free the TCP ports between 5000 and 5020 for SSO (for additional information see the article https://msdn.microsoft.com/en-us/library/aa559472.aspx).

 

Restart the MSDTC taking the MSDTC Resource offline/online in Failover Cluster Manager.

 

To confirm MSDTC is using the correct port:

1. Open an Administrative command prompt and run Netstat –ano to get the port and the Process Identifier (PID)
   
2. Start Task Manager and select Details tab
   
3. Find MSDTC.exe and get the PID
   
4. Review the output for the PID to show it is MSDTC
   

 

Apply the same configuration to the second node.

 

Step 8: Cluster the Master Secret Server

 

From this time, the installation is pretty standard so I will not go into details because I think it was enough documented.

To cluster enterprise SSO follow the article at this link https://msdn.microsoft.com/en-us/library/aa561823.aspx.

After the installation, you need to set “Use Network Name for computer name” setting on cluster resource property and make the resource dependent from SQL Server cluster resource.

Following some relevant step of my configuration.

 

 

 

 

 

I have completed the configuration of the second node after a failover, so to work always on the active node.

 

 

 

 

Step 9: Install BizTalk nodes

 

1. In the task bar of the Azure Management Portal, click NEW > COMPUTE > VIRTUAL MACHINE > FROM GALLERY.
   
2. On the Choose an Image page, click BizTalk Server 2013 R2 Eenterprise, and then click the Next arrow.
   
3. On the Virtual machine configuration page:
   

• In VIRTUAL MACHINE NAME, type BTLABBT1.
  
• Select a size.
  
• In NEW USER NAME, type the name of a local administrator account.
  
• In NEW PASSWORD and CONFIRM, type a strong password for the local administrator account.
  
• Record the local administrator account name and password in a secured location.
  

1. Click the Next arrow.
   
2. On the second Virtual machine configuration page:
   

• In CLOUD SERVICE, select the cloud service that you created in “Step 1: Create the Azure Virtual Network.”
  
• In REGION/AFFINITY GROUP/VIRTUAL NETWORK, select BtLabNet.
  
• In STORAGE ACCOUNT, select the storage account that you created in “Step 1: Create the Azure Virtual Network.”
  
• In AVAILABILITY SET specify Create an availability set and specify its name.
  
• In ENDPOINTS, in the PowerShell row, delete the default port number in the PUBLIC PORT column.
  

 

 

 

Join BizTalk Server to Active Directory Domain

 

1. In the left pane of Server Manager, click Local Server.
   
2. In the contents pane, in the PROPERTIES group, click WORKGROUP and then Change
   
3. Select Domain and specify btlab.pellitterisbiztalkblog.com
   
4. Specify the administrator credentials and confirm.
   
5. Click OK on Welcome to domain dialog box and then restart the machine.
   

 

Installing and configuring BizTalk Server

 

Following some relevant picture about my BizTalk configuration.

 

 

 

 

 

 

 

Configuring second node

 

Repeat this step for the second BizTalk server.

Following some relevant step of the configuration I applied.

 

 

 

 

 

 

That’s all folks.

 

 

Considerations

 

The experience that I did opens discussion points. I have done some tests trying to stress much as possible the communication with SQL Server and the MSDTC. During my tests I hadn’t particular problems, however, the limited number of available dynamic RPC ports, lead me to think that a limit, this infrastructure has it.

The scenario 1, exposed at the beginning of this article, is definitely easier and does not have this kind of problem, however, limits the performance as it concentrates all services in a single host with no ability to scale.