Tuesday, December 12, 2023

Visualizing ingested events in Azure Event Hub with Azure Data Explorer

In modern cloud-based solutions, event-driven architectures are very common. Microsoft Azure facilitates event processing through Azure Event Hubs, offering essential building blocks to implement scalable solutions capable of processing large volumes of events and data with low latency and high reliability.

Debugging or testing event-based solutions can be challenging due to the nature of their architecture. It requires implementing ingesting applications and consumers to verify the functionality of event-based solutions.

In this article, I will demonstrate how to leverage Azure Data Explorer to visualize ingested data without any delay. With this solution, there is no need to create any custom solutions to view the contents of our Event Hub instance.

First, we need to create our Azure Data Explorer cluster.


Next, we will create a database in Data Explorer.


To connect Data Explorer with Event Hubs, let's enable a managed account at the Data Explorer instance.


After enabling the managed account at the Data Explorer instance, we need to assign the required permissions to the Event Hub.


Now, let's configure Data Explorer for our Event Hub. Navigate to the Event Hub and select the "Analyze data" option.














Let's link our Data Explorer instance















Now that our configuration is complete, let's ingest some data and explore it in Data Explorer.

To explore our data, navigate to Data Explorer and go to the Query section. Then, select the table and run your query to explore the ingested data.










No comments: