Introduction

In this release, the connection functionality to different Kafka clusters has been integrated to manage the most common components of a cluster, such as topics and consumer groups.

...

• Connections:

  • Create a connection to a cluster, setting the necessary connection properties.

  • Modify / delete connections.

  • List the connections.

  • Access the data of a Cluster: Topics and Consumer Groups.

• Topics:

  • Creation / modification / deletion of topics: we can specify partitions, replicas and any necessary properties.

  • Other operations:

    • Data insertion.

    • Query of the last x records.

    • Data purge.

• Consumer groups:

  • Viewing consumers and sharing partitions.

  • Viewing of the state of consumption by partition and its lag.

  • Offset alteration:

    • at the beginning of the topic.

    • at the end of the topic.

    • at a certain timestamp.

How does it work?

From the Control Panel, we can access it from the TOOL menu.mDEVELOPMENT > Kafka cluster management,

...

where we will be shown the list of connections that we have defined.

Connections to Kafka

...

Pressing the + button, we can create a new connection, where we will have to indicate name, description and list of brokers (host:port separated by commas)

...

• General Information: Brokers that make up the cluster.

...

• Topics:

...

• Consumer groups:

...

Topics

Once we are inside a connection, we can perform the following operations:

...

Consumer groups

Within a connection, we can view the list of consumer groups. We can perform the following operations on them:

...