Preference measurement can be approached in two ways: The former is a "bottom-up" approach where feature importance is first ascertained and then used to create product attractiveness scores. While Conjoint Analysis has received considerable attention in the literature and has been used often by practitioners, Self-Explicated Method is seldom used. This is in spite of academic studies showing that Self-Explicated Method can be as good as conjoint in some cases and may even be preferable in specific situations.
The objective of this paper is to conduct a split sample study to compare the results of the two methods, in order to demonstrate the application of SEM and study its relative effectiveness when compared to Conjoint Analysis. Self-Explicated Method is much easier than Conjoint Analysis to design and analyze.
As with Conjoint Analysis we start with a definition of features and levels that we are interested in studying.
But product profiles are not constructed as would be done in Conjoint Analysis. Instead, survey respondents are presented the features individually and asked for their evaluations. Specifically, levels of each feature are first presented and respondents evaluate their desirability. So for example, if in an auto study gas mileage were a feature and 20mpg, 25mpg and 30mpg were three levels, then respondents are asked to evaluate the desirability of those three levels on a scale.
There are at least two ways of doing this. One is to provide a straight desirability rating on a scale of, say, Another is to ask for the most desirable level and assign it a value of 10, ask for the least desirable level and assign it a value of 0, and then have the remaining levels assigned appropriate values in-between 0 and Once the desirability scores are assigned to various levels, the respondents are asked to evaluate the importance of the features.
This can again be done in at least two different ways. Respondents could rate features on regular importance scales say Alternatively, they could use a constant sum scale to assign points in accordance with the importance of each feature. Since there is a built in trade-off in the constant sum scale the importance scores are likely to be more accurate. Once the level desirability and feature importance scores are obtained, simple multiplication of the two produces utility scores for every level of every feature.
Thus levels that are desirable and occur in important features will have higher utility scores, while those that occur in less important features will have appropriately lower scores.
Practically the utility scores obtained using Self-Explicated Method are similar to those obtained through Conjoint Analysis even though the latter are derived using a much more complicated process. The SEM utilities are available at the individual respondent level and can hence be used for simulations or follow-up segmentation.
If it is so straightforward and simple to use, how is it that Self-Explicated Method is not more popular? There are at least a few issues that may impact the results of SEM and therefore need to be considered before implementation. Respondents approach the task feature by feature and hence the whole product perspective that is often seen in CA is missing.
The whole product is what a consumer sees in the marketplace and hence it could be argued that CA is more realistic. Conversely, the advantage of SEM is that a large number of features can be included in the study. Evaluation by feature also means that respondents are not aware of what features are coming up and hence may provide higher or lower ratings to levels seen earlier. To avoid this, respondents need to be made familiar with all features and levels before they begin their evaluations.
Evaluation by feature may also result in distributions of utilities that are "flatter" when compared to the distribution of utilities from CA. That is, the scores of very important features may be underestimated and that of unimportant features may be over-estimated. This happens because each feature is considered individually and rated, something that may not actually happen in the marketplace.
Such a phenomenon has also been observed in variations of CA where respondents are not asked to evaluate the entire product. A split sample design was used on a web sample for studying the choice of checking provider accounts. SEM respondents rated desirability on a scale and feature importance on a point constant sum scale. CA respondents were given a discrete choice exercise. The study included eight features with two to four levels per feature.
As can be seen from the table, feature importance scores for the Self-Explicated Method are not very different from those obtained using Conjoint Analysis. There is some level of underestimation at the upper end but, by and large, the SEM results are comparable. At the utility score level also there is considerable correspondence between the two methods.
A third cell had been included in the design that also used in Self-Explicated Method. The main difference was that the feature importance for the third cell was measured using a standard scale instead of a constant sum scale. What is interesting is that the results of the third cell mirror those of the SEM results reported here almost exactly.
This has implications for data collection. CA is almost impossible to do over the phone, but a large number of market research studies are conducted over the phone. How can one get Conjoint Analysis -like results using a phone study?
Based on the results from the third cell, it would seem that an SEM with importance scales could be done over the phone, and good results can be expected. Of course, it would make sense not to have too many features, too many levels per feature, or lengthy descriptions of levels. Deriving Value from Research: Use of Conjoint Analysis for Product Development.
How to Measure the Value of a Brand. Conjoint Analysis A split sample design was used on a web sample for studying the choice of checking provider accounts.
No min balance and No monthly fees. Free online banking and bill pay. Supermarket where you shop. ATMs at branches only. ATMs at branches and other places. Had prior relationship with the bank.More...