Skip to content
QuorlyticTalk to a Data ExpertContact
Menu
Illustration: a lit storefront on a waterfront street at night, with store, cart, device and delivery icons linked across a glass panel beside it.

Industry / Retail & ecommerce

Connect the customer, the shelf and the decision.

Data and AI for retail and ecommerce connects order, customer and inventory data across channels into one reconciled view, so commercial and planning teams stop working from conflicting numbers. Quorlytic models transactions, returns and promotions separately, resolves customer identity with visible match confidence, and scopes the first data product around one operational decision.

By QuorlyticUpdated

Retail decisions are made in hours against data that arrives on different clocks: a sale is known at the till, an inventory position is known at the next sync, a return is known a fortnight later. This page sets out the lifecycle those decisions sit in, the data each one needs, and what has to be true before analytics or AI can support them.

  • One customer identity
  • Promotions flagged in history
  • Freshness per decision
  • Margin after returns
  • Channels reconciledStore, web and marketplace orders compared on one definition of a sale
  • Identity with confidenceGuest, account and loyalty records joined with the match confidence kept
  • Forecasts you can order fromDemand at the grain replenishment places an order in, uncertainty exposed
  • Effects, not just creditPromotion and campaign results measured against a comparison group

Lifecycle

The retail data-to-decision lifecycle

Eight stages, each producing the data the next one depends on. The loop matters more than any single stage: a pricing decision taken without knowing what fulfilment did to margin is a guess wearing a number.

  1. Sense demand

    Read what customers are actually buying, at the grain replenishment works in. Sales are not demand: a line that sold zero because it was out of stock reads identically to a line nobody wanted.

    Data
    Transactions by store, channel and day; on-hand positions; web sessions and search terms; competitor and weather context where it is genuinely used.
    Decision
    Which products and locations need attention this week.
  2. Plan the assortment and the inventory position

    Decide what to carry, where, and how much. The constraint is rarely the forecast — it is lead time, minimum order quantity and shelf space, which the forecast must be expressed in terms of.

    Data
    Product hierarchy, supplier lead times, order multiples, store capacity, season and event calendar.
    Decision
    Range, depth and initial allocation per location.
  3. Price and promote

    Set price, plan markdowns, design promotions. Every promotion also contaminates the demand history it runs against, which is why promotional periods have to be flagged in the data rather than reconstructed later.

    Data
    Price history, cost, competitor price where licensed, promotion calendar and mechanics, elasticity estimates.
    Decision
    Price points, markdown timing, promotion mechanics and guardrails.
  4. Acquire and recognise customers

    Bring customers in and work out who they are across guest checkout, multiple accounts and offline purchases. Identity resolved badly is worse than identity left unresolved, because everything downstream inherits the error silently.

    Data
    Advertising platform spend and exposure, web and app events, loyalty enrolment, consent records.
    Decision
    Where to spend, and which customer record a transaction belongs to.
  5. Sell across channels

    Take the order wherever it happens. The same physical unit can be promised to a store shopper and a web basket in the same minute, so the timeliness of the inventory position is a commercial decision, not a technical preference.

    Data
    Orders, baskets, payment authorisations, channel and fulfilment method, stock reservations.
    Decision
    What to show as available, and where to source each order from.
  6. Fulfil, ship and absorb returns

    Pick, ship, deliver — then handle what comes back. Returns arrive weeks after the sale and after the reporting period that recorded it, which is why net and gross measures have to be modelled separately rather than reconciled by hand.

    Data
    Shipments, carrier events, delivery confirmations, return authorisations, restocking and disposition outcomes.
    Decision
    Fulfilment routing, and whether a line is genuinely sellable again.
  7. Retain and grow customers

    Work out who is worth keeping and what to offer them. A lifetime-value figure that cannot be reproduced next quarter is a number, not a decision input.

    Data
    Purchase history under a resolved identity, service contacts, consent and channel permissions, margin by product.
    Decision
    Which segment receives which offer, through which channel.
  8. Measure and correct

    Close the loop: compare what was planned against what happened, and change the plan. This is the stage that is skipped most often, and it is the one that makes every earlier stage improvable.

    Data
    Forecast versus actual at the planning grain, promotion results against a comparison group, availability and margin outturn.
    Decision
    What to change in the next planning cycle, and which model to stop trusting.

Where it breaks

Where retail data estates break

These are the failures that appear in retail data estates repeatedly. None of them is solved by a dashboard.

The same customer is several customers

Guest checkout, a second account with a work email, a loyalty card used by a household and an in-store purchase with no identifier all describe one person, and the estate has no rule that says so.

What it costsSegments are wrong in a direction nobody can quantify, lifetime value is understated for exactly the customers worth keeping, and suppression lists miss the person who asked not to be contacted.

Product hierarchies disagree with each other

Merchandising, finance and the ecommerce catalogue each maintain a category tree, and a variant that is one item in one system is three in another.

What it costsCategory performance cannot be compared across channels, forecasts are built at a grain that replenishment cannot order in, and margin analysis silently mixes variants with different costs.

Inventory is stale before it is read

The position a planner sees is the position at the last sync, and the sync interval was chosen by the integration rather than by the decision it feeds.

What it costsAvailability promises are made against stock that has already sold, and the resulting oversells are attributed to demand volatility rather than to latency. The fix is usually matching the ingestion pattern to the decision rather than refreshing a dashboard more often.

Promotions contaminate the history they run against

Promotional periods are not flagged in the transaction record, so a model trained on the last two years learns promotional demand as baseline demand. Evaluating a forecast on the wrong measure hides the effect for another quarter.

What it costsForecasts overshoot after every campaign, planners lose confidence in the model, and the override becomes the process.

Margin is assembled differently in each channel

Store margin excludes fulfilment cost, digital margin includes shipping but not returns processing, and finance restates both at period end.

What it costsChannel comparisons drive range and investment decisions that reverse the moment the definitions are reconciled — the pattern described in why two dashboards disagree.

Returns arrive after the decision they affect

A return is recorded weeks after the sale, in a different system, sometimes without the original order reference.

What it costsGross and net sales diverge by category, cohort profitability is overstated for the highest-return lines, and repeat-purchase measures count a returned item as a purchase.

Functions

What each retail function owns

Retail organisations are structured by function, and each function owns a different question. The data foundation has to serve all six without forcing them into one definition of everything.

Retail business functions, the question each owns, and what answering it requires
FunctionThe question it ownsData it needsAnalyticsDecision
Customer and loyaltyWho is this customer, what are they worth, and what are we permitted to do with that?Resolved identity, transaction history, consent and channel permissions, service contactsIdentity resolution, segmentation, retention and value modellingWhich customers receive which offer, and through which channel
Merchandising and assortmentWhat should we carry, where, and in what depth?Product hierarchy, sales and margin by location, space and capacity constraints, supplier termsPerformance analysis by category and location, assortment and space planningRange, depth and store-cluster allocation
Pricing and promotionsWhat should this cost, and what did the last promotion actually do?Price and cost history, promotion calendar and mechanics, competitor price where licensed, volume responseElasticity estimation, promotion evaluation against a comparison group, markdown optimisationPrice points, markdown timing, and which mechanics to repeat
Inventory and supplyWhat do we need, where, and by when?On-hand and in-transit positions, supplier lead times and reliability, order multiples, demand forecastHierarchical forecasting, safety-stock and replenishment policy, exception detectionOrder quantity, timing and allocation across locations
Store and fulfilment operationsCan we serve this order profitably from here?Stock accuracy, labour and capacity, carrier performance, fulfilment cost by nodeAvailability and fill-rate analysis, sourcing cost comparison, exception workflowsWhere each order is sourced from and what is shown as available
Marketing and performanceDid that spend cause incremental sales, or describe them?Platform spend and exposure, orders under a resolved identity, comparison groups, margin after returnsAttribution, incrementality testing, contribution modellingBudget allocation across channels and campaigns

Decisions

Four retail decisions, traced end to end

Four decisions, traced from the question a buyer asks to the measure that says whether the answer worked. The caveat on each one is part of the map, not a disclaimer attached to it.

Which products does each location need next week?

  1. Question
  2. Data
  3. Analytics
  4. Decision
  5. Measurement

Data required

  • Sales at the replenishment grain
  • On-hand and in-transit inventory
  • Supplier lead times and order multiples
  • Product hierarchy with variant mapping
  • Promotion calendar, flagged in history
  • Event and season calendar

Analytics

  • Forecasting at the grain the order is placed in
  • Reconciliation across the product and location hierarchy
  • Stockout-aware history correction
  • Exception detection for lines that need a human

Decision

Order quantity and timing per product and location, with the exceptions a planner should review first.

Measurement

  • Forecast error at the planning grain, weighted by volume
  • Stockout rate on the lines that matter commercially
  • Inventory turns
  • Proportion of orders released without intervention

What this does not settleA forecast does not improve availability on its own. It improves availability when replenishment can turn it into an order quantity inside the lead time, and when the exceptions it raises reach someone who can act before the window closes.

What did the last promotion actually do?

  1. Question
  2. Data
  3. Analytics
  4. Decision
  5. Measurement

Data required

  • Transactions with promotional periods flagged
  • Promotion mechanics, funding and duration
  • Price and cost at the time of sale
  • A comparison group of stores, regions or customers that did not receive it
  • Returns attached to the promoted lines

Analytics

  • Comparison against the untreated group rather than against the prior period
  • Cannibalisation analysis across substitute lines
  • Margin after funding and after returns

Decision

Whether to repeat the mechanic, at what depth, and on which lines.

Measurement

  • Incremental units and margin against the comparison group
  • Cannibalisation rate on substitutes
  • Return rate on promoted lines
  • Share of volume that would have occurred anyway

What this does not settleWithout a comparison group this analysis describes what happened during the promotion, not what the promotion caused. Where a holdout is commercially impossible, say so in the output rather than presenting the uplift as an effect.

Which customers are worth retaining, and what are we allowed to send them?

  1. Question
  2. Data
  3. Analytics
  4. Decision
  5. Measurement

Data required

  • Identity resolution output with match confidence retained
  • Transaction and return history under that identity
  • Consent and channel permission records
  • Margin by product, not revenue alone
  • Service and complaint history

Analytics

  • Identity resolution with a stated confidence threshold
  • Cohort and repeat-purchase analysis
  • Value modelling on margin after returns
  • Segment definition tied to an available action

Decision

Which segment receives which offer, on which channel, at what frequency.

Measurement

  • Repeat purchase rate by cohort
  • Contribution after returns and fulfilment
  • Consent coverage of the addressable segment
  • Proportion of segments with a named owner and an action

What this does not settleA lifetime-value number computed on revenue rather than margin, or on an identity that cannot be reproduced next quarter, will rank the wrong customers first. Keep match confidence visible in the output and treat low-confidence merges as unresolved rather than joining them anyway.

Where should the next unit of marketing budget go?

  1. Question
  2. Data
  3. Analytics
  4. Decision
  5. Measurement

Data required

  • Platform spend and exposure by channel
  • Orders joined to a resolved customer identity
  • A holdout or geography-based comparison design
  • Margin after returns by product
  • Organic baseline outside campaign periods

Analytics

  • Attribution to describe the observed path
  • Incrementality testing to establish causal effect
  • Contribution modelling across channels where an experiment is not possible

Decision

Budget allocation across channels, and which campaigns to stop.

Measurement

  • Incremental contribution against the comparison group
  • Cost per incremental order, not per attributed order
  • Share of conversions the model cannot observe
  • Consistency of the answer between methods

What this does not settleAttribution distributes credit within the population the platform already targeted, which is optimised toward people likely to convert. It answers a different question from incrementality, and the two should be reported next to each other rather than one being presented as the other.

Illustrative interface

Replenishment review — the exceptions a planner should see first

A fictional screen showing the shape of a replenishment exception queue. No real retailer, product, supplier or figure is represented, and every value here is invented.

Replenishment review — the exceptions a planner should see first
Line and locationSignalConstraintSuggested action
OK: Core line · 40 storesDemand steady, cover within policyOrder multiple respectedRelease without review
Watch: Seasonal line · 12 storesSell-through ahead of planSupplier lead time exceeds remaining coverReview before the cut-off
Risk: Promoted line · all storesHistory contains an unflagged promotionForecast trained on distorted demandHold — correct the history first
Watch: Long-tail line · 3 storesIntermittent demand, several zero weeksPercentage error undefined on zerosEvaluate on a volume-weighted measure
  • Release — the recommendation can go without a person looking at it
  • Review — a real constraint needs a human decision before the cut-off
  • Hold — the input is known to be wrong, so the output should not be acted on

Data foundation

The retail data foundation

Retail data arrives from a dozen systems, each with its own identifier, clock and definition of a completed transaction. The foundation's job is to make them comparable without flattening the differences that matter.

  1. Source systems

    Different clocks, different identifiers. The ten systems are enumerated in the table below.

    • Transactional systems
    • Customer and consent systems
    • Product, price and promotion systems
    • Supply, marketplace and returns feeds
  2. Ingestion

    Pattern chosen per source, from the decision it feeds

    • Log-based CDC from operational databases
    • API extraction
    • Nightly supplier batch
    • Event streams for basket and stock movement
  3. Cloud platform

    One place the reconciled history lives

    • Raw landing, preserved as it arrived
    • Validated and deduplicated models
    • Business-ready marts
  4. Identity & hierarchy

    The layer most retail estates skip

    • Customer identity with match confidence retained
    • Product variant and hierarchy mapping
    • Location and channel mapping
    • Consent and permission scope
  5. Quality & contracts

    A breach fails a build, not an inbox

    • Freshness and completeness checks per source
    • Declared schema and compatibility rules
    • Reconciliation against the system of record
    • Lineage from mart back to source
  6. Semantic layer

    One definition, not one dashboard

    • Net sales after returns
    • Margin after funding and fulfilment
    • Availability and on-shelf position
    • Customer contribution
  7. Decision surfaces

    Where the work is actually done

    • Trading and category reporting
    • Demand forecast and replenishment exceptions
    • Customer segments and audiences
    • Pricing and promotion evaluation
    • Permission-aware retrieval
  8. Action

    A decision with an owner and a measurement

    • Replenishment orders
    • Price and markdown changes
    • Campaign and audience activation
    • Fulfilment routing
Reference architecture — a target-state shape, not a description of a client engagement.

Ingestion pattern follows the decision, not the other way round. Where a source is an operational database and the decision needs same-day positions, log-based change data capture reads the transaction log instead of querying the table, which keeps load off the system of record. Where a supplier sends a file once a night, a nightly batch is the honest answer and a streaming pipeline is expensive theatre. For stock-position feeds that genuinely need event-level updates, scope streaming ingestion and correction handling around the replenishment decision rather than treating every retail source as real time.

10 source systems, and what to check before trusting each
  • Point of sale

    Store transactions, tender, discounts applied at the till, voids

    Check before trustingLate store polling and offline periods; discount reasons recorded inconsistently between chains

  • Ecommerce platform

    Baskets, orders, sessions, promotional codes, guest and account checkouts

    Check before trustingOrder state changes after capture; a basket is not an order and both are often exported to one table

  • Order management

    Order lifecycle, allocation, cancellations, partial shipments

    Check before trustingThe authoritative state of an order usually lives here, not in the channel that took it

  • Inventory and warehouse

    On-hand, reserved, in-transit and in-store positions

    Check before trustingSync interval versus the decision the position feeds; reserved stock counted as available

  • Enterprise resource planning

    Cost, purchase orders, supplier terms, financial postings

    Check before trustingCost is restated at period end, so a margin figure has a version as well as a value

  • Product information management

    Hierarchy, attributes, variants, lifecycle status

    Check before trustingThe hierarchy finance uses and the one merchandising uses are frequently not the same tree

  • Customer relationship and loyalty

    Accounts, loyalty identifiers, contact and consent preferences

    Check before trustingConsent has a scope and an expiry; carrying the flag without the scope is not consent

  • Advertising platforms

    Spend, impressions, clicks, platform-attributed conversions

    Check before trustingEach platform attributes with its own model and window, so summing them double-counts

  • Supplier and marketplace feeds

    Availability, lead times, marketplace orders and fees

    Check before trustingArrives on the supplier's schedule and format; lateness is normal and must be modelled, not treated as an outage

  • Returns and reverse logistics

    Return authorisations, receipts, disposition and restocking

    Check before trustingOften lacks the original order reference, which has to be recovered before net measures are possible

Analytics & AI

From agreed reporting to AI, in dependency order

The order below is not a maturity badge — it is a dependency chain. Each rung is unreliable until the one above it holds, which is why an AI programme that begins at the bottom usually ends up rebuilding the top.

  1. Reporting that teams agree on

    One definition of net sales, margin and availability, reconciled with the people who own the process. This is unglamorous and it is the thing that stops two meetings using different numbers.

    RequiresAgreed metric definitions, a source of record per measure, and a published refresh time

  2. Diagnosis

    Explaining a movement: which categories, locations and customer groups drove it, and how much of it is a data artefact such as a restated cost or a late return batch.

    RequiresConsistent hierarchies, period-correct history, and the ability to separate restatements from trade

  3. Forecasting

    Predicting demand at the grain replenishment orders in, with uncertainty exposed rather than hidden behind a single number.

    RequiresStockout-aware history, flagged promotional periods, and an evaluation metric matched to what an error costs

  4. Optimisation and recommendation

    Turning a prediction into a recommended quantity, price or offer, inside the constraints the business actually operates under — order multiples, shelf space, margin floors.

    RequiresEncoded constraints, a named owner for each recommendation, and an override path that is recorded

  5. Assisted retrieval and generation

    Letting a merchant or analyst ask a question in language and get an answer grounded in governed data, with the source shown. Useful when the corpus is governed; misleading the moment it is not.

    RequiresPermission-aware retrieval, a curated corpus with owners, and an evaluation set that tests refusal as well as answers

  6. Agentic workflows

    Letting a system take a bounded action — raising a replenishment exception, drafting a supplier query — with a human accountable for the outcome and a log of what it did.

    RequiresEverything above, plus explicit action boundaries, reversibility, and monitoring that a human reads

Maturity

A maturity progression, with readiness tests

Most retail data estates sit between the second and third stage. The useful question is not which label applies but what specifically is missing before the next stage is worth funding.

  1. Visibility

    Reports exist, are late, and are rebuilt in spreadsheets before anyone presents them.

    Ready for the next stage whenA source of record is agreed for sales, inventory and cost, and the refresh time is published rather than assumed.

  2. Agreed definitions

    One number per measure, reconciled with finance and merchandising, and the differences between channels are explained rather than argued about.

    Ready for the next stage whenDefinitions are owned by a named person, tested in the pipeline, and a breach fails a build instead of generating a message.

  3. Prediction

    Forecasts exist at the planning grain and are evaluated by product group and location rather than in aggregate.

    Ready for the next stage whenHistory is stockout-aware and promotion-flagged, and planners can see the uncertainty rather than a single number.

  4. Decision systems

    Predictions arrive as recommended quantities and prices inside real constraints, with overrides recorded and reviewed.

    Ready for the next stage whenConstraints are encoded, exceptions route to an owner, and the override rate is monitored as a signal rather than ignored.

  5. Assisted operations

    Retrieval and bounded automation support the people making the decisions, and every action is attributable.

    Ready for the next stage whenPermissions are enforced at retrieval time, the corpus has owners, and there is an evaluation set that would catch a regression.

Measurement

What a retail organisation should measure

A measurement framework for the decisions above. What matters is the pairing: a measure with no decision attached becomes a number somebody defends rather than uses.

Retail measures, what each one captures, and the decision it informs
MeasureWhat it capturesDecision it informs
Weighted forecast errorForecast accuracy weighted by volume, so the lines that matter commercially dominateWhether the forecast is fit to place orders from
Forecast biasSigned error over time — persistent over- or under-forecasting that absolute measures hideWhether to adjust the model or the planner's default behaviour
Stockout rateHow often a line is unavailable where demand existedSafety-stock policy and replenishment frequency
On-shelf availabilityWhether stock recorded as held is actually sellable at the point of demandStore process and count-cycle investment, not just ordering
Inventory turnsHow hard working capital is working, by category and locationRange depth and allocation
Gross margin after returnsMargin once returns, funding and fulfilment cost are deductedRange, channel and promotion economics
Promotion incrementalityVolume and margin caused by a promotion, against a comparison groupWhich mechanics to repeat and at what depth
Repeat purchase rate by cohortWhether acquired customers come back, by the period they arrived inAcquisition spend and retention programme design
Contribution per customerMargin after returns attributable to a resolved identity over a defined windowWhich segments justify which offer
Return rate by lineProportion of units returned, and the disposition they receiveRange decisions, sizing guidance and product-detail accuracy

These are common retail measures and their usual reading, not results Quorlytic has produced for a client. Definitions vary between organisations — agree yours before comparing anything.

Principles

Principles we work to

The 6 principles this work is built on
  1. 01

    Unify the meaning of a transaction

    Orders, payments, returns and shipments arrive at different times. Model them separately and reconcile net sales before comparing stores or channels. Map product variants, promotions and currencies so a dashboard does not mistake an accounting difference for a commercial trend.

  2. 02

    Understand customers without losing their context

    Build identity rules that account for guest checkout, multiple accounts and consent. Keep match confidence visible and avoid combining records simply because two customers share a name. Connect permitted customer views to meaningful service and marketing workflows.

  3. 03

    Plan with uncertainty

    Forecast at a grain and horizon that match replenishment. Stockouts hide demand, promotions distort history and new products lack observations. Evaluate by product group and location, expose uncertainty and retain planner overrides.

    • Customer and channel performance
    • Demand and inventory planning
    • Margin, returns and promotion analytics
  4. 04

    Scope the first data product

    Choose one operational question, such as which products need replenishment review. Identify the source owner, available history, action cadence and acceptance metric. Expand only after the first output has a dependable owner and is used in a real decision.

  5. 05

    Pricing and promotion decisions need their own evidence

    Price and promotion analysis describes what happened under earlier decisions, which is not the same as what will happen under a new one. State the assumptions, set guardrails for margin, service level and customer impact, and prefer a controlled test where one is possible. A model that only explains history should not be presented as a forecast of a price change.

  6. 06

    Customer insight depends on identity you can defend

    Segment and lifetime analysis break when identity is guessed. Decide how guest checkout, multiple accounts, shared devices and consent are handled, keep match confidence visible, and connect each segment to an action with an owner. A customer view that cannot be reproduced or explained is worse than no view at all.

Engagement

How an engagement can progress

A typical engagement can progress through these stages. It is a sequence, not a proprietary method, and each stage produces something you keep whether or not the next one happens.

  1. Discover

    OutputAn inventory of the decisions in scope, who makes them, on what cadence, and what they currently use

  2. Audit the data

    OutputA source and quality map: what each system carries, how late it arrives, and where the definitions disagree

  3. Design the architecture

    OutputA target-state design with the ingestion pattern chosen per source and the identity rules written down

  4. Build the foundation

    OutputPipelines, models and quality gates for the sources the first decision needs

  5. Build the decision layer

    OutputThe forecast, segmentation or measurement the decision requires, evaluated the way the business will read it

  6. Operationalise

    OutputMonitoring, named ownership, an exception path and a runbook for when a source fails

  7. Measure and improve

    OutputA decision-level measurement framework, and the next decision prioritised against it

Where this connects

Capabilities that support these decisions

Further reading, chosen for this lifecycle

Questions

Questions worth asking.

Is this a packaged retail application?

These are engineering and analytics engagements scoped around your environment. Existing retail systems are inputs to the architecture; a new application is not automatically required.

Your next data decision

Start with a clear problem.
Build what comes next.

Talk to a Data Expert

Bring the business question.
We'll help shape the engineering brief.