Browsed by
Tag: database

PostgreSQL index optimization

PostgreSQL index optimization

Comments 0 Comment

Some time ago, I worked on query execution time optimizations for PostgreSQL, I talk about it here: The VISUALVM SQL PROFILE. Kestra is a highly scalable data orchestration and scheduling platform that creates, executes, schedules, and monitors millions of complex pipelines. It’s also the company I work for! The open source version of Kestra uses a database engine, while the Enterprise Edition lets you use an alternative engine based on Kafka and Elasticsearch. The database engine supports H2, PostgreSQL and…

Read More Read More

VisualVM SQL profiler SQL

VisualVM SQL profiler SQL

Comments 0 Comment

A little while ago, I discovered the SQL profiler of VisualVM and I thought I should share it with you ;). VisualVM is a tool that provides a visual interface to display detailed information about applications running on a Java Virtual Machine (JVM). VisualVM is designed for use in development and production. VisualVM provides lightweight profiling tools including a SQL profiler. This will detect each SQL query (passing through the JDBC layer) and group them in a tabular view with…

Read More Read More

Apache Pinot and its various types of indexes

Apache Pinot and its various types of indexes

Comments 0 Comment

Some time ago, I finally took the time to test Apache Pinot, you can find the story of my first experiments here. Apache Pinot is a distributed real-time OnLine Analytical Processing (OLAP) datastore specifically designed to provide ultra-low latency analytics, even at extremely high throughput. If you don’t know it, start by reading my introductory article before this one. One of the strengths of Pinot is its different types of indexes, it is these ones that we will explore in…

Read More Read More

I finally took the time to test Apache Pinot

I finally took the time to test Apache Pinot

Comments 2 comments

I’ve been wanting to test Apache Pinot for a very long time and I finally took the time to do it! First, a quick description of Pinot Pinot is a real-time distributed OLAP datastore, purpose-built to provide ultra low-latency analytics, even at extremely high throughput. It can ingest directly from streaming data sources or batch data sources. At the heart of the system is a columnar store, with several smart indexing and pre-aggregation techniques for low latency. Pinot was built…

Read More Read More