Diagnose customer retention: Define repeat purchase with consistent rules and timing; Check data freshness and reporting period accuracy; Compare mature groups using same follow-up window
Image: Retention Marketing Desk

Churn Diagnosis

Customer retention diagnosis

Diagnose a retention problem by defining eligible repeat purchases, checking buying cycles and investigating plausible causes before choosing an action.

Customer retention diagnosis starts with one precise question: among customers who had a reasonable opportunity to buy again, what changed in their purchasing, and what might explain it? A quiet order history is an observation only. It does not prove a customer has left or that a campaign will bring them back.

Define the purchase you expect to repeat

Choose the customer group, product category and follow-up period before calculating a rate. Count completed purchases consistently, and decide how to treat cancellations, refunds, exchanges and subscription renewals. If a buyer moves between pack sizes or close substitutes, an identical-product count may miss a genuine repeat purchase.

Start with a meaningful first purchase and give customers the same amount of time to return. A buyer acquired last week cannot fairly be compared with one acquired last year on whether they made a second purchase within six months.

Check whether customer records join online and in-store orders reliably. A missing link can make a returning buyer look new.

Buying opportunities differ by category. A household consumable may be needed again soon; a durable item may not.

Separate products with different buying rhythms before treating a longer gap as a retention problem. Keep customers whose next purchase opportunity is unclear in an unknown group.

Read several signals together

No single number identifies the cause of fewer repeat sales.

QuestionUseful observationWhat it cannot establish alone
Are first-time buyers returning?Share of a mature first-purchase group making a qualifying second purchase within a fixed periodWhy the others have not bought
Are established buyers slowing?Time since the last relevant order compared with suitable past buying gapsWhether an individual has permanently left
Is the commercial result changing?Completed repeat orders and net sales, with contribution assessed only where costs are reliableWhether a retention action caused the change
Is there a plausible experience problem?Recurring delivery, product or support issues in order and case recordsThat every affected customer stopped buying for that reason

Check the denominator as well. A larger share of orders from returning customers can reflect fewer new customers rather than stronger repeat behaviour. Report returning and eligible customer counts alongside any percentage.

Key Metrics in Customer Retention Diagnosis

Share of returning buyers
Percentage of first-time customers making a second purchase within a fixed period
Time since last order
Compared against historical buying gaps to detect slowing behaviour
Net sales from repeat orders
Revenue after discounts and reversals; used to assess commercial impact
Eligible customer count
Number of customers with opportunity to return; essential for denominator accuracy
Return rate trend
Change over time in repeat purchase rates; indicates potential systemic issues

Investigate the pattern before choosing an action

Compare mature groups whose first purchases occurred in comparable periods. Use the same elapsed follow-up time and qualifying-purchase rule.

If a decline appears in one category, region or first-order route, investigate that group. Compare like seasons where buying opportunities vary through the year.

Review a sample of order histories for bulk purchases, returns, substitutions, stock gaps and subscription deliveries that may explain longer intervals. Read the underlying service records before assigning a cause from case tags.

Some unhappy customers never contact support, while frequent buyers may have more occasions to do so.

Write down competing explanations. A fall in second purchases after a product launch might reflect a product issue, a longer use cycle, missing linked orders or a change in the mix of first-time buyers.

State what evidence would strengthen or weaken each explanation. An association between complaints and inactivity warrants investigation; it does not establish that the complaints caused every later gap.

Pros and Cons of Using Case Tags to Identify Retention Issues

  • ProsCan reveal recurring delivery, product or support issues; useful for spotting patterns
  • ConsDoes not prove all inactive customers were affected; some unhappy customers never contact support

Check what the report actually counts

Before treating a dashboard as current, check its data freshness. Shopify's Customer reports might not display activity from the past 12 hours, while its New vs returning customer report is up to date, give or take a few seconds.

Refreshing a report can display newer data.

Check whether the reporting period refers to the date of an order or the period in which a customer is classified. Shopify's customer reports use a customer's entire order history, not only orders placed during the selected timeframe.

For example, a customer whose first order was in November can appear as returning in a November report if their second order is placed in December.

Shopify defines a first-time customer as someone who placed their first order with the store, and a returning customer as someone whose order history already includes at least one order.

Its New vs returning customers report displays the number of customers in each group, so distinguish that count from the number of orders they placed.

Use a consistent sales measure when checking whether repeat purchasing changed. Shopify defines net sales as gross sales minus discounts and sales reversals, and describes it as an approximation of actual revenue.

Total sales includes additional amounts such as fees, duties, shipping charges and taxes, so it answers a different question from net sales.

Shopify Customer Report Definitions: New vs Returning Customers

  • New CustomerSomeone who placed their first order with the store
  • Returning CustomerSomeone whose order history already includes at least one order
  • Reporting Period FocusCustomer's entire order history, not just orders within the selected timeframe
  • Net Sales DefinitionGross sales minus discounts and sales reversals (approximation of actual revenue)
  • Total Sales InclusionIncludes fees, duties, shipping charges, and taxes – answers a different question than net sales

Match the response to the finding

If evidence points to a recurring operational failure, assign an owner and check whether the repair reduces it. If a gap falls within the product's usual buying window, continue ordinary service rather than labelling the customer lost.

If records cannot reliably identify repeat orders, repair the measurement before setting a campaign target.

For a proposed reminder, service change or offer, define the eligible group, intended outcome and review period in advance. Later purchases show what happened.

Estimating whether the action added purchases requires a suitable comparison group that did not receive it.

Keep a short record of the customer and product group, purchase rule, follow-up window, observed change, alternative explanations, evidence reviewed and next check.

Revisit it when the product mix, data or buying cycle changes.

In this guide

  1. Retention versus loyalty: defining the business problemLearn what repeat purchases can show, what loyalty requires beyond order data, and how to write a useful customer problem statement.
  2. Choosing a repeat-purchase measure for a product categoryChoose a category-appropriate repeat-purchase metric with a clear numerator, eligible customer group, purchase definition and follow-up window.
  3. Separating customer loss from naturally infrequent buyingAssess a quiet customer history against product buying opportunities, comparable purchase gaps and complete observation windows.

More from Churn Diagnosis

Churn Diagnosis

Checking whether product expectations match the purchase page

Checking whether product expectations match the purchase page: practical criteria and a clear evaluation process for marketing teams.

Churn Diagnosis

Churn research

Investigate apparent customer churn through interviews, purchase histories and findings that distinguish reported reasons from observed facts.