go-kafka

Go Kafka app

This is a simple app built using Golang, Kafka, and PostgreSQL. It exposes several APIs to create and fetch users and products. Utilizes Kafka for retrieval and publishing of data.

Fig: Workflow of the APP

GO RESTful APIs

I built a server using Golang and PostgreSQL. It exposed many API endpoints to create users as well as products. It also exposes a special GET endpoint that can be used to listen to the Kafka Queue

Fig: Directory structure

Fig: API endpoints for the app

Kafka server

Fig: Kafka Server is ran locally on the machine as looks like this

1. Post a product

Create a post request for adding Product to the database

Fig: POST API for the creation of products. This houses a function to publish onto a Kafka queue.

2. Publish to Kafka

The API function calls in itself, a function to publish onto the Kafka queue

Figure: Kafka consumer acknowledges that it can see a value.

Figure: Logger for successful publishing

3. Consume Kafka

We try to get the data from the Kafka queue, using a function for consumer

Figure: A GET API to call the Kafak consumer, fetch from DB and return value.

4. Return value

We try to get the data from the kafka queue, using a function for consumer

Fig: Finally returns a value.