In most marketing experiments, managerial decisions are not based directly on the estimates of the parameters, but rather on functions of these estimates. For example, many managerial decisions are driven by whether or not a feature is valued more than the price the consumer will be asked to pay. In other cases, some managerial decisions are weighed more heavily than others. The standard measures used to evaluate experimental designs (e.g., A-efficiency or D-efficiency) do not accommodate these phenomena. We propose alternative “managerial efficiency” criteria (M-errors) that are relatively easy to implement. We explore their properties, suggest practical algorithms to decrease errors, and provide illustrative examples. Realistic examples suggest improvements of as much as 30% in managerial efficiency. We close by considering approximations for non-linear criteria and extensions to choice-based experiments.
Toubia, Olivier, and John Hauser. "On Managerially Efficient Experimental Designs." Marketing Science 26, no. 6 (2007): 851-858.
Each author name for a Columbia Business School faculty member is linked to a faculty research page, which lists additional publications by that faculty member.
Each topic is linked to an index of publications on that topic.