In the Technopark Sena Node Neiva, located in the department of Huila in Colombia, a project is underway that utilizes an IoT device developed by the incubated talent Jorge Lurduy from the company IntegraSoft. This device, named GeeenWay, monitors real-time consumption of residential gas services and stores the information in cloud databases using JSON technologies through the MongoDB database engine. In collaboration with Technopark, they are implementing an ETL tool that extracts information from databases and subsequently uses it in streaming for predictive analysis of user consumption. The goal is to accurately predict the next customer consumptions and provide valuable information in the subsequent bill.

In the development of this project, technologies from Databricks and connectors from the community version of MongoDB were employed. Databricks technology allows the implementation of Kafka, Python, and SQL query language code in a single interface. Furthermore, it enables the management of a pilot that can later be scaled up, leveraging the Apache Spark technology integrated into these tools.

It is crucial to highlight that this technological approach enables efficient data management and seamless integration between IoT devices and analysis platforms. The ability to perform real-time predictive analysis with Databricks and connectivity with MongoDB provides a robust and scalable solution to anticipate residential gas consumption patterns. This project not only translates into improved operational efficiency but also adds value to the information delivered to users on their bills, promoting more conscious and efficient use of public services.