Gianfranco Demarco

Data & AI Engineer | M.Sc. in Artificial Intelligence

Posts

DumbDB III: from text to results - an high-level overview

An high-level overview of how a textual SQL query is processed by a DBMS to produce a result

Data Engineering

DumbDB II: introducing the Hash Index

Implementing a Hash Index in to boost the performance of the Append-Only Database

Data Engineering

DumbDB I: an Append-Only Database

Developing a dumb DBMS from scratch using Python - implement the most common operations on with an Append-Only Database

Data Engineering

Interactive Debugging With Dagster and Docker

December 2, 2024

How to set up interactive debugging using Dagster in a Dockerized environment so that you can inspect your assets, sensors, and even Dagster's code at runtime - all without any differences from your production environment.

Data Engineering

Projects

DumbDB: Implementing a dumb DBMS from scratch

Implementing a dumb DBMS from scratch using Python

Converso

Converso is a LangChain extension that streamlines data acquisition and action execution through natural language

Converso Chatbot

Converso Chatbot is an end-to-end chatbot based on Converso, which uses Telegram as a frontend

ZeroDocs

ZeroDocs is a tool that provides an easy way to provide docstrings for your code with (kinda) zero effort, leveraging OpenAI’s APIs.

Price Oracle

Price Oracle is an end-to-end solution for monitoring and predicting the price of criptocurrencies. It is composed of data ingestion pipelines leveraging Apache Airflow, an Apache Cassandra database, machine learning models built with TensorFlow and a front-end built with Grafana.

vollAIball

Agents learning volleyball in a Unity3D environment, using Reinforcement Learning and with a Prolog Narrator.

Plate Recognition

End-to-end Computer Vision project, with reproducibility, CI/CD and monitoring.