Guides / customer analytics
Customer segmentation and conjoint analysis
Segmentation sorts customers into groups. Conjoint works out what they will trade off. Both are routinely run, routinely over-trusted, and routinely presented as though the output were a discovery rather than a choice the analyst made. This guide works both through with numbers, covers how many segments you actually have, and shows how to read part-worth utilities without overstating them.
Segmentation divides existing customers into groups that resemble each other, using data you already hold. It is descriptive and the number of groups is a decision, not a finding. Conjoint analysis is experimental: you show people designed combinations of product features, observe their choices, and estimate how much each feature is worth to them. Segmentation tells you who your customers are. Conjoint tells you what they will give up to get something else.
Definitions
What segmentation actually does
Clustering algorithms always return clusters. Give k-means random noise and ask for four groups and it will produce four tidy groups with centroids and sizes. Nothing in the output tells you whether the structure was in the data or imposed on it.
That is the single most important thing to understand before presenting a segmentation to a board.
| Method | How it groups | Watch for |
|---|---|---|
| k-means | Minimises distance to cluster centres | Needs k chosen in advance. Assumes roughly spherical, similar-sized clusters. Sensitive to scaling. |
| Hierarchical | Builds a tree of nested groupings | No need to fix k upfront, but it does not scale, and the linkage choice changes the answer. |
| Latent class | Model-based, assigns probabilities | Gives fit statistics you can compare, which the others do not. Slower and needs more care. |
| RFM | Recency, frequency, monetary value, usually in tiers | Crude, transparent, and often more actionable than anything clever. |
k-means works on distances, so a variable measured in pounds will overwhelm one measured in visits purely because its numbers are bigger. Standardise everything before clustering. Skipping this step is the commonest reason a segmentation turns out to be a map of whichever variable had the largest units.
Worked example one
How many segments?
Run k-means for k from 1 to 7 and record the within-cluster sum of squares, which measures how tightly points sit around their centre.
| k | Within-cluster SS | Reduction on previous |
|---|---|---|
| 1 | 1,000 | — |
| 2 | 620 | 38.0% |
| 3 | 430 | 30.6% |
| 4 | 360 | 16.3% |
| 5 | 330 | 8.3% |
| 6 | 312 | 5.5% |
| 7 | 300 | 3.8% |
Reading it
Adding a second group explains 38% more. A third adds 30.6%. The fourth adds 16.3% and the fifth only 8.3%. The gains flatten after three or four, which is the elbow.
Note what the table does not do: it never stops improving. Within-cluster sum of squares falls at every k, all the way to one cluster per customer. There is no value of k at which the algorithm tells you to stop. The elbow is a judgement.
Three checks worth running alongside it
The missing check
The question nobody asks: is it stable?
A segmentation that changes when you resample the data is not describing your customers. It is describing this particular extract.
Test it directly. Split the data in half at random, cluster each half separately, and see whether the same segments appear. Or bootstrap: resample with replacement fifty times, recluster, and measure how often pairs of customers land together.
The Jaccard index is the usual summary. Above 0.75 a cluster is stable and worth naming. Between 0.6 and 0.75 it is a pattern worth noting. Below 0.6 it will not reproduce and should not be built into a strategy.
Segments get named, given personas, and written into campaign plans and sometimes into org charts. If the underlying grouping would not survive a resample, all of that is built on an artefact of one data pull. Running the stability check takes an afternoon. Discovering the problem after a rebrand does not.
The same caution applies to profiling. Once segments exist, people test them against every variable in the database to describe them, which is a large number of comparisons and will throw up differences by chance. Treat profiling as description, not as hypothesis testing, or correct for the multiplicity.
The simple alternative
RFM, and when crude beats clever
Before commissioning a clustering exercise, it is worth asking whether RFM would do the job. It often does, and it has advantages no algorithm offers.
Score every customer on three things: how recently they bought, how frequently, and how much they spent. Divide each into quintiles, 1 to 5, and you have a three-digit code per customer.
A worked cut
Take 10,000 customers and split each dimension into five equal groups of 2,000.
| Code | Meaning | Roughly | Action |
|---|---|---|---|
| 555 | Bought recently, often, and a lot | ~80 customers | Protect. Early access, named contact. |
| 155 | Was valuable, has not returned | ~80 | Win back. This is the highest-value intervention available. |
| 511 | New, one purchase, low value | ~80 | Onboard and develop. |
| 111 | Long gone, infrequent, low value | ~80 | Suppress. Stop spending on them. |
Cell sizes are roughly even by construction if the three dimensions were independent, which they are not, so in practice the corners fill up and the middle thins out. That is informative in itself.
Why it holds its own against clustering
Where it falls short
RFM says nothing about why. It cannot incorporate product mix, channel, demographics or stated preference, and it treats the three dimensions as equally important when they rarely are. For a subscription business where almost everyone buys on the same cadence, frequency carries no information at all and the method collapses to two dimensions.
Run RFM first. If it separates your customers in ways the business recognises and can act on, you may be finished. Move to clustering when you have variables RFM cannot use and a specific question it cannot answer. Starting with the complex method and working backwards is how segmentation projects run long and deliver personas nobody uses.
A different question
How conjoint works
Asking customers what matters to them produces a list on which everything matters and price matters most. Conjoint avoids this by never asking the question directly.
Instead respondents choose between whole product configurations, each a bundle of attribute levels. Because the bundles are designed so attributes vary independently, the choices reveal the trade-offs people will actually make.
Choice-based conjoint, where people pick one bundle from several, is the standard today because it mirrors a purchase decision. Older ratings-based designs ask people to score configurations and are easier to run but further from real behaviour.
Worked example two
Part-worths and importance
A choice experiment on four attributes returns these part-worth utilities, averaged across respondents.
| Attribute | Levels and part-worths | Range | Importance |
|---|---|---|---|
| Price | £20 = +0.85 · £30 = +0.10 · £40 = −0.95 | 1.80 | 49.3% |
| Delivery | Next day = +0.42 · 3 days = +0.05 · 7 days = −0.47 | 0.89 | 24.4% |
| Support | 24/7 = +0.30 · Office hours = −0.30 | 0.60 | 16.4% |
| Brand | Known = +0.18 · Unknown = −0.18 | 0.36 | 9.9% |
How importance is calculated
Take the range of each attribute's part-worths, then express each as a share of the total.
Price range = 0.85 − (−0.95) = 1.80
total of all ranges = 1.80 + 0.89 + 0.60 + 0.36 = 3.65
Price importance = 1.80 / 3.65 = 49.3%
The caveat that should always accompany it
Importance depends entirely on the levels you chose. Price looks dominant here partly because the range tested was £20 to £40, a doubling. Test £28 to £32 instead and price would look unimportant, not because customers stopped caring but because you stopped varying it.
Attribute importance is a statement about your experimental design as much as about your customers. Report the levels alongside the importances, every time.
Honesty
What conjoint cannot tell you
Doing it
In R, SPSS and Stata
R
Segmentation, with scaling and the stability check that usually gets skipped.
d <- scale(customers[, vars])
km <- kmeans(d, centers = 4, nstart = 25)
factoextra::fviz_nbclust(d, kmeans, method = "silhouette")
fpc::clusterboot(d, B = 100, clustermethod = fpc::kmeansCBI, k = 4)
nstart = 25 matters: k-means starts from random centres and can land in a poor solution, so it should be restarted many times. clusterboot returns the Jaccard stability per cluster.
For choice-based conjoint, support.CEs builds the design and mlogit or bayesm estimates it, with ChoiceModelR for hierarchical Bayes.
SPSS
QUICK CLUSTER z_recency z_frequency z_value
/MISSING = LISTWISE
/CRITERIA = CLUSTER(4) MXITER(50) CONVERGE(0)
/METHOD = KMEANS(NOUPDATE)
/PRINT ID(custid) INITIAL ANOVA.
Standardise the inputs first with DESCRIPTIVES /SAVE, since QUICK CLUSTER will not do it for you. SPSS has a Conjoint module with the CONJOINT command, but it handles ratings-based designs rather than modern choice-based conjoint.
Stata
cluster kmeans z_*, k(4) start(random(12345)) name(seg4)
cluster stop seg4, rule(calinski)
tabstat spend visits, by(seg4) stat(mean sd n)
For conjoint, clogit choice attr1 attr2, group(taskid) fits the conditional logit, and mixlogit allows preferences to vary between respondents, which is the practical equivalent of hierarchical Bayes.
Both k-means and hierarchical Bayes depend on random starting values. Without a fixed seed the segmentation you present on Monday may not be the one you can reproduce on Friday, and you will not be able to explain why. Record the seed in the methods alongside the software version.
Avoid these
Six mistakes that cost you money
| Mistake | Why it matters |
|---|---|
| Not scaling before clustering | k-means works on distance, so the variable with the largest units dominates. The segmentation becomes a map of that one variable. |
| Treating the number of segments as a finding | Within-cluster SS improves at every k. The algorithm never says stop. Choosing k is a judgement and should be presented as one. |
| Skipping the stability check | A segmentation below 0.6 Jaccard will not reproduce. Personas and campaigns then rest on one data pull. |
| Quoting attribute importance without the levels | Price looks dominant at £20 to £40 and trivial at £28 to £32. Importance describes your design as much as your customers. |
| Reading preference share as market share | It ignores distribution, awareness, switching costs and every competitor you left out of the design. |
| Averaging part-worths across opposed groups | A mean utility across two segments with opposite preferences describes nobody in the sample. |
Clusters always appear, including in random data, so the real question is whether the same ones come back on a different sample. Send the data and you get segments tested for stability, profiled, and sized so the commercial case is honest.
See survey and insight analysis
Tara SutariaSenior Statistical AnalystWriting it up
How to report it
Common questions
Frequently asked questions
How many customer segments should I have?
There is no statistical answer, because within-cluster variation falls at every additional segment all the way to one customer per group. Use the elbow in the within-cluster sum of squares, silhouette width above about 0.5, and whether the business can actually act on the number you pick. Three or four is common and usually more useful than seven.
Do I need to standardise variables before clustering?
Yes, for any distance-based method such as k-means. Spend measured in pounds and visits measured in counts are on completely different scales, so without standardising, the variable with larger numbers dominates the distances and the segmentation mostly reflects that one variable.
How do I know my segments are real?
Test whether they reproduce. Split the data in half and cluster each half, or bootstrap fifty resamples and measure how often the same customers group together. A Jaccard index above 0.75 indicates a stable cluster; below 0.6 it will not reproduce and should not be built into strategy.
What is a part-worth utility?
The value a respondent places on one level of one attribute, estimated from the choices they made between whole product configurations. Summing the part-worths of a configuration gives its total utility, and comparing total utilities predicts which option people prefer.
How is attribute importance calculated?
Take the range between the highest and lowest part-worth within an attribute, then express it as a share of the total of all such ranges. A price range of 1.80 against a total of 3.65 gives price an importance of 49.3%. The figure depends heavily on the levels tested, so always report them alongside.
Can conjoint predict my market share?
No. It predicts share of preference among the configurations shown to respondents in a survey. Real market share depends on distribution, awareness, salesforce, switching costs and competitor reaction, none of which the experiment contains. Treat it as a comparison between options, not a forecast.
How many attributes can a conjoint handle?
Around six before respondents start simplifying, typically by focusing on one or two attributes and ignoring the rest. The model will still return clean estimates for every attribute, which is what makes over-specification dangerous rather than obviously wrong.
Keep reading
Related
Customer satisfaction and NPS
Measuring the relationship, and why the usual metric is noisier than it looks.
Self-selection bias
Who answers your survey, and why it is not a random slice of your customers.
Survey and insight analysis
Survey and choice data analysed and reported so the findings hold up.
Related services
If the findings have to persuade a board
Survey and insight analysis
Survey data analysed and reported so the findings hold up to scrutiny.
Fixed quoteStatistical consultancy
Design, analysis and reporting for charities, universities, the NHS and business.
From £950Data cleaning & preparation
Messy data made analysis-ready, with a documented log of every change.
Fixed quoteEvery piece of work is done and signed by a named statistician. Send the data or describe the project and you get a price and a deadline, usually within one working day.