
Optimizing Data Pipelines with Apache Iceberg and S3: How We Accelerated Parquet Processing

Ya.Digital Project by Yarmarka GC and abgroup.tech Nominated for Data Award 2026
Yarmarka Group of Companies (a food and food ingredients manufacturer), together with our team at abgroup.tech, has elevated business management to a new level of accuracy and speed. Our joint project — Ya.Digital, a unified ecosystem for analytics, forecasting, and budgeting — has been shortlisted for the prestigious Data Award 2026.
About the Project
We developed not just another accounting system for Yarmarka, but a comprehensive management decision portal. Before implementation, data was fragmented: 1С accounting, external sales databases, and numerous Excel files. Analytics were delayed by up to a month and a half, and key metrics (e.g., profit) were calculated differently across departments, leading to conflicts and inefficient decisions.
Our Solution
We built a corporate data warehouse using Managed Service for ClickHouse with DBT transformations, configured end-to-end analytics in DataLens, and developed an industry-specific budgeting service.
The key technical achievement is the automatic consolidation of three sales levels (primary, secondary, and tertiary) into a single model. This provides management with a complete picture: from factory shipments to actual sales on store shelves.
Results and Impacts
By transitioning from fragmented reporting to an integrated system, Yarmarka achieved measurable business results:
🔹 30–40% reduction in the planning (budgeting) cycle in the initial phase.
🔹 Direct savings of approximately 70 million RUB per year by reducing labor costs for data collection and validation.
🔹 Market reaction time decreased from one and a half months to just one day.
🔹 Increased demand forecasting accuracy through comprehensive analysis of all sales channels.
The project enabled a shift away from "driving using the rearview mirror" and provides tools for promptly adjusting promotions, optimizing inventory, and identifying growth points.
The Data Award nomination recognizes that the developed architecture and data management approach set new analytics standards for the FMCG sector.
An in-depth interview with Oleg Bogomolov, Director of Strategy and Digital Transformation at Yarmarka GC, is available at: https://www.osp.ru/articles/2026/0312/13060516
Congratulations to the Yarmarka GC team on this well-deserved nomination!