Installing Azure

1. Create “Event Hub”

Using the official Azure documentation Quickstart: Create an event hub using Azure portal

2. Create a new “Shared access policy” to allow access to the Event Hub created, make sure you select the “Listen” permission.

3. Get the Event Hub Shared Access policies - Connection string–primary key from “Shared access policy” created previously. It will be used to configure your tenant.

Sample Connection string–primary key:

4. Get the Consumer Group Name

In: All services-> Event Hubs -> Your_Event_Hub_Namespace -> Event Hubs -> Your_Event_Hub_Instance -> Consumer groups. It will be used to configure your tenant.

Create a new consumer group specifically for Logstash. Do not use the $default or any other consumer group that might already be in use. Reusing consumer groups among non-related consumers can cause unexpected behavior and possibly lost events. All Logstash instances should use the same consumer group so that they can work together for processing events.

5. Create a “Storage Account”

Using the official Azure documentation Quickstart: Create a storage account

6. Get the “Storage Container Name”

In: All services -> Storage accounts -> Your_Storage_Account -> Containers. It will be used to configure your tenant.

7. Get the Storage Account Connection string with key to access Azure “Storage Account”.

Find the connection string here: All services -> Storage accounts -> Your_Storage_Account -> Access keys. It will be used to configure your tenant.

Sample connection string:

8.Configure your Azure Subscription to send log to the Event Hub

Go to Subscription and click on “Resource providers”. Search for “Event Grid”, and make sure is registered in the “Resources providers”.

9. Create a new Event by clicking in the Events -> Event Subscription

10.Configure the “Event Subscription” to send logs to the Event Hub created previously.

11. Use the data collected in the previous steps to fill the form as documented below. You can add more than one Event Hub configuration by clicking on the Add tenant button.

  • The input field Event Hub Shared access policies - Connection string refers to Azure’s Event Hub Shared Access Policies - Connection string-primary key: Value obtained in step 3
  • Consumer Group Name: Value obtained in step 4
  • Storage Container Name: Value obtained in step 6
  • Storage Account Connection string with key: Value obtained in step 7