Kafka

Apache Kafka is a distributed, scalable and open-source platform. It is used to create data processing pipelines and real-time streaming data applications. Its system is well-known for facilitating the real-time management of large databases. It is compatible with a wide range of programming languages (frameworks) such as Python, Query, PHP, Java, and Ruby.

The incoming data transferred through this system are organised into topics, which can be structured according to the type of collected data they contain. Apache Kafka’s clustered architecture is orchestrated by a timestamp that sorts, replicates, then distributes this data. The sources publishing data in these topics are called “producers” or “publishers”. Those who read this data are called “consumers” or “subscribers”. They can both access Kafka Stream, the platform’s Java library.  The library uses queues to manage the data flows between these sources without overloading them. It is therefore able to distribute information between different systems (such as servers, data storage spaces, and relational databases). This centralised management facilitates the processing of large volumes of data generated by big data, machine learning, and more.

This solution is ideal for applications that require fast live data analysis. Its role as a broker in centralised message processing also allows for a better management of your information.

Both solutions are open-source, but have different advantages. As mentioned above, Kafka’s strength is its ability to manage high volumes of data. It is more useful if you are working with big data or machine learning. RabbitMQ is better suited for low-latency message delivery and complex routing. Furthermore, this solution is actually a piece of distribution software rather than a distribution platform.

Managed Databases for Kafka is a DBaaS (Database as a Service). It is one of the managed services available on our Public Cloud. Our goal is to save you time in your job, by entrusting us with the management and maintenance of your database.

Once you have downloaded and accepted Kafka’s licence agreement, it is indeed possible. However, you will also need to manage and administer the database, and you will not benefit from the capabilities we provide in our turnkey service.

Each plan includes different features for different uses. Among other factors, they do not all have the same benefits or the same level of availability.

No. You retain complete control over your data. When you use Managed Databases for Kafka, your data is placed in a storage space dedicated solely to your use.

You can do this if you need more RAM. However, you cannot revert to a lower-capacity node.

Yes. We provide automated backups with each solution. However, the default retention policies differ depending on the chosen range.

Yes, our service can be used as a resource, or as part of a Public Cloud infrastructure. You can manage it from your Control Panel, the OVHcloud API or the OpenStack API. We also offer managed services for managing relational databases (SQL), such as MySQL and PostgreSQL, or non-relational databases (NoSQL), such as Redis or MongoDB.

We perform all database management and administration tasks for you, so you don’t have to worry about maintenance. It is this added value that we charge as a service.

Yes, Managed Databases for Kafka can be connected to your dedicated server via a public or private network. However, you will need to do this yourself, and then manage and administer your own database.