March 4, 2019

Monitoring Azure File Sync

After implementing Azure File Sync, you wonder, how I can monitor what I just implemented? My first thought was to investigate in the Azure Resource himself, to look the sync service and see whether there are any diagnostics settings which can be enabled in order to send logs to Log Analytics where we could set up alerts. However, there weren`t any diagnostics options on the Azure resource, so I then looked in the documentation: https://docs.microsoft.com/en-us/azure/storage/files/storage-sync-files-troubleshoot?tabs=portal1%2Cazure-portal#sync

Using the portal is not ok, if you want something ongoing with more of the “enterprise look” (like receive email, alerts, so on), although it’s fine for an interactive ad-hoc checks.

The second option presented at the documentation, is event logs on the servers where the Sync Service is installed.

For Azure File Sync, Microsoft is continuing working on Azure Monitor integration (view metrics, logs and configure alerts). Microsoft recently added some additional metrics in Azure Monitor (see details below) and they will continue to add more in a very near future. Logging and alerts should be available by later this year.

Then I decide to dive deep and see how we can monitor Azure File Sync. These are some of the monitoring options are available today:

Monitoring Option #1: Azure Portal

Use the portal to view the Registered server state and Server endpoint health (sync health). These are the components of the Azure File Sync that you should monitor:

Registered Server State

  • If Registered server state = Online, then the server is successfully communicating with the service.
    • If Registered server state = Offline or Appears Offline, verify if the Storage Sync Monitor (AzureStorageSyncMonitor.exe) process on the server is running.
      NOTE: If the server is behind a Firewall or Proxy, configure the firewall and proxy.

Server Endpoint Health

  • The server endpoint health in the portal is based on the sync events that are logged in the Telemetry event log on the server (ID 9102 and 9302). If a sync session fails due a transient error (e.g., error cancelled), sync may still show healthy in the portal as long as the current sync session is making progress (Event ID 9302 is used to determine if files are being applied).
    • If the portal shows a sync error due to sync not making progress, then you need to troubleshoot the issue, I recommend to check the Troubleshooting Sync Error for guidance.

Monitoring Option #2: Use Telemetry event logs on the Windows Server

Use the Telemetry event logs to monitor registered server, sync, and cloud tiering health. The Telemetry even logs are located under Applications and Services>Microsoft>FileSync>Agent in Event Viewer

Sync

  • Event ID 9102 is logged once a sync session completes. This event should be used to determine if sync sessions are completing successfully (HResult = 0) and if there are per-item sync errors.
    • Event ID 9302 is logged every 5 to 10 minutes if there’s an active sync session. This event should be used to determine if the current sync session is making progress (AppliedItemCount > 0). If sync is not making progress, then the sync session should eventually fail and an Event ID 9102 will be logged with the error.

Registered Server Health

  • Event ID 9301 is logged every 30 seconds when a server queries the service for any jobs. If GetNextJob completes with status = 0, then the server is able to communicate with the service.

Cloud Tiering

  • Tiering
    • Use Event ID 9002, 9003, 9016 and 9029 to monitor tiering activity and errors.
  • Recall
    • Use Event ID 9005, 9006, 9007 to monitor recall activity and errors.

Monitoring Option #3: Use Azure File Sync performance counters

Use the Azure File Sync performance counters to monitor sync activity.

  • Current Performance counters
    • AFS Bytes Transferred
      • Downloaded Bytes/sec
      • Total Bytes/sec
      • Uploaded Bytes/sec
    • AFS Sync Operations
      • Downloaded Sync Files/sec
      • Total Sync File Operations/sec
      • Uploaded Sync Files/sec

Monitoring Option #4 – Portal: Azure Monitor integration

The initial integration will have charts which provide the following information: Files Synced, Bytes Synced, Files Not Syncing, Sever Heartbeat and Recall Activity

  • Portal: View Cloud Tiering health
    • Cloud tiering health will be displayed in the portal (similar to the server endpoint sync health status).

Cheers,

Marcos Nogueira
Azure MVP

azurecentric.com
Twitter: @mdnoga

Written by Marcos Nogueira

Marcos Nogueira

With more than 18 years experience in Datacenter Architectures, Marcos Nogueira is currently working as a Principal Cloud Solution Architect. He is an expert in Private and Hybrid Cloud, with a focus on Microsoft Azure, Virtualization and System Center. He has worked in several industries, including Aerospace, Transportation, Energy, Manufacturing, Financial Services, Government, Health Care, Telecoms, IT Services, and Gas & Oil in different countries and continents. Marcos was a Canadian MVP in System Center Cloud & Datacenter Managenment and he has +14 years as Microsoft Certified, with more than 100+ certifications (MCT, MCSE, and MCITP, among others). Marcos is also certified in VMware, CompTIA and ITIL v3. He assisted Microsoft in the development of workshops and special events on Private & Hybrid Cloud, Azure, System Center, Windows Server, Hyper-V and as a speaker at several Microsoft TechEd/Ignite and communities events around the world.

Share

Marcos Nogueira

With more than 18 years experience in Datacenter Architectures, Marcos Nogueira is currently working as a Principal Cloud Solution Architect. He is an expert in Private and Hybrid Cloud, with a focus on Microsoft Azure, Virtualization and System Center. He has worked in several industries, including Aerospace, Transportation, Energy, Manufacturing, Financial Services, Government, Health Care, Telecoms, IT Services, and Gas & Oil in different countries and continents. Marcos was a Canadian MVP in System Center Cloud & Datacenter Managenment and he has +14 years as Microsoft Certified, with more than 100+ certifications (MCT, MCSE, and MCITP, among others). Marcos is also certified in VMware, CompTIA and ITIL v3. He assisted Microsoft in the development of workshops and special events on Private & Hybrid Cloud, Azure, System Center, Windows Server, Hyper-V and as a speaker at several Microsoft TechEd/Ignite and communities events around the world.

You may also like...

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: