A snack retailer runs an eight-week video campaign with attributed sales. The campaign targets snack lovers, gamers, and millennials. The test results are as follows:
What should the company test using experimental design to improve efficiency in number of exposures?
Answer : A
A clothing retailer recently streamlined its online ordering process in an effort to drive more sales. A four-week broadly targeted digital campaign was launched across Facebook, YouTube, display and programmatic video to promote the recent changes. The client is interested in determining high-performing conversion paths to develop a sequencing strategy moving forward.
What measurement approach should be used to determine the success of the campaign?
Answer : A
An analyst has calculated an average lift from a random sample of 300 similarly sized campaigns. The analysis showed the following:
* Minimum lift is 98
* Maximum lift is 177
* 95% confidence interval for the average lift per campaign is (133, 145)
* Average p-value for each individual campaign's lift is p = 0.03
What should the analyst conclude about the distribution of lifts?
Answer : B
A car manufacturer discovers that the purchase journey is typically one-year long, involves several media channels and is followed by a dealership visit that ends with a purchase at the dealership. Historically, sales are mostly influenced by the quality of the customer service experience. The manufacturer has a KPI of driving incremental customers to its website.
What measurement solution should be used?
Answer : D
A large gaming company is developing a measurement strategy designed to shift its planning and buying on Facebook. The company believes that its ability to iterate on testing will provide more long-term growth than the short-term sales boosts from individual campaigns. The conversion rate is high enough that they should have NO issues with statistical power at any size of test/holdout groups. It is planning on running multi-cell Conversion Lift tests on a monthly basis.
What test/holdout proportions should the company use for each test cell?
Answer : A