Back to our work
Data engineering

A unified data warehouse for sales and digital analytics

A BigQuery warehouse that brought sales, e-commerce, web analytics and sales-force data together, with Power BI reporting and market basket analysis for the US and Canada.

Period
Mar 2021 - Jul 2021
Our scope
Architecture, ELT & Power BI reporting
Engagement
Delivered by the aiLabs founders
Data sources and reporting in the Tupperware warehouse Sales, e-commerce, web analytics and sales tools feed the warehouse’s landing, integration and analytics layers. The result supports Power BI views and market basket analysis. SalesE-commerceWeb analyticsSales tools LandingIntegrationAnalytics Power BI views Basket analysis
Explanatory diagram illustrating the engineering approach.

Key results

  • Tupperware accepted the complete solution for the US and Canada, including the warehouse, its data pipelines and Power BI reporting views.
  • Around 3 million order lines analysed to find products bought in similar patterns.
  • A warehouse architecture ready to bring in the company’s other regions.

The challenge

Tupperware wanted to see how e-commerce, digital tools for its sales force and virtual parties affected sales. The data was spread across Oracle EBS and Magento sales, Google Analytics 360, a learning platform and several in-house applications, with no single place to analyse it.

Our contribution

  • Designed the enterprise data warehouse: landing, integration and analytics layers, data quality rules and a path from a fast first release to a multi-region warehouse.
  • Defined the BigQuery schemas and analytical data models and built Power BI views for reporting on traffic, conversion, revenue and the effect of digital sales tools.
  • Led the development of Apache Airflow pipelines that load sales, product and sales-force data from Google Cloud Storage into BigQuery, with encoding handling, limits on the number of invalid records and a log of loaded files.
  • Built market basket analysis: an item-by-order matrix, SVD and cosine similarity to find products with similar purchase patterns for cross-selling.

What the work delivered

Tupperware received the complete solution it had requested for the US and Canada. The Power BI views gave users a way to work with the warehouse data for reporting and analysis.

More engineering stories

View all work
Applied ML

Real-time bidding optimisation

A bid optimisation system for advertising campaigns on The Trade Desk: event data pipelines, simulation-tested algorithms and services that adjust bids across many dimensions every hour.

Computer vision

Planogram compliance

As part of the client’s team, we built the 2D matching engine and backend. Cutting matching time for 80 products on one side of a fixture from 53 to 3-4 seconds made photo-based planogram checks practical on the shop floor.

Platform engineering

Platform modernisation

Cloud-independent infrastructure, event-driven services and a faster, cheaper data layer for an established learning analytics platform.

Let’s build something useful

Bring us the
hard part.

A new AI capability, a complex data problem or a platform that needs to evolve. Tell us what you’re working on.

Discuss your project

Start a conversation

info@ai-labs.tech

aiLabs Innovations FZ-LLC
Compass Building, Al Shohada Road, Al Hamra Industrial Zone-FZ, Ras Al Khaimah
United Arab Emirates
Licence No. 47014246

For an initial conversation, share your goal, the current system and the challenge you want to solve.