Client Overview

Agriprove, Australia’s leading developer of soil carbon projects, sought to simplify the complex process of managing soil carbon credits, making it easier for farmers to participate in carbon offset programs.

Objective

To develop a streamlined process for the registration, generation, and claiming of soil carbon credits, reducing the administrative load on farmers.

Challenges

  • Data Variety

Handling data from diverse sources like IoT devices, lab reports, and government records, leading to varied data formats.

  • Real-time Analytics

Essential for actionable insights and quick response to policy changes and customer behaviors.

  • Data Quality

Ensuring accuracy and consistency in data to support reliable analytics and decision-making.

Proposed Solutions

  • Soil Data Pipeline

Automated ETL tasks to efficiently process and store data in a PostgreSQL database, leveraging AWS services for scalability.

  • GIS Data Pipeline

Implemented for parsing and transforming geographic data, with Airflow for scheduling and AWS Glue for data cataloging.

  • Cecil Data Pipeline

Converted to a near real-time, event-based system using AWS SNS and SQS, ensuring data integrity and loss prevention.

  • Calculator Pipelines

Automated complex calculations related to soil carbon through AWS Lambda, API Gateway, and EventBridge, streamlining manual tasks.

Results

  • Agriprove now benefits from real-time data pipelines capable of processing data with CDC and event-based methodologies.
  • These pipelines are highly scalable, with robust failsafe mechanisms to handle real-time failures, optimizing the data management process by 60%.

This collaboration with Pixid has enabled Agriprove to significantly improve the efficiency and reliability of soil carbon credit management. The innovative data pipelines have not only reduced the administrative burden on farmers but also enhanced the overall productivity and sustainability of soil carbon projects.