Quotas
Feedback > Surveying > Sampling > Quotas
Quotas are the last step in the Sampling process: they attempt to achieve a target number of responses for survey emails sent in a given time period. They can limit the count of emails for high-traffic units to allow lower-traffic units to be statistically significant in the overall scores and results. For example, if a unit has a quota of 300 responses per month, that unit needs to receive about 10 responses a day. When the Response rate is 70%, Experience Cloud knows to send out 14 invitations to achieve the target 10 responses for the Unit.
Quotas can also capture certain proportions of the contact base (by segment), such as to ensure a significant number of high-loyalty contacts are includes in the results. However, tracking happens in the sampler, so if you add segments, the response rate resets.
Each day Experience Cloud compares the current response rate to the target rate necessary to meet the quota. When necessary, Experience Cloud adjusts the number Invitation emails sent to better assure the quota number of responses are received for invitation emails sent before the end of the quota period. When there are not enough responses to calculate the current response rate within the recent past, Experience Cloud estimates the response rate per a specification defined on the Response Rates screen.
The response rate is company’s historical rate: all Unit calculations use the same rate. However, when using Use per-Unit response rate in the Sampler, Experience Cloud calculates the rate for each unit individually: high response-rate units need fewer invitations to achieve the same target.
When the Quota finishes evaluating its rules, it sends a report to the email addresses listed in the Quota Management Report Email property defined in the Sampler. Use that report to evaluate how well Quota is doing, and to determine when to adjust the settings for calculating the response rate and thresholds.
Using a Quota rule
Quota rules are associated with a Sampler and that Sampler must be associated with an Auto Importer. Follow these steps to use a Quota rule:
e_unitid) value. This impacts programs that have multiple units assigned to a single record.- If a default Sampler does not exist or work for this quota, create a sampler. For example,
name = "my_sampler". Note that the sampler does not need Episode conditions. - Create a quota rule and associate that rule to the sampler. For example,
Survey Sampling Setting = "my_sampler". - Create an Auto Importer and tell it to use the sampler:
<survey-processor-options samplingSettings="my_sampler" />
sampling_settings field: <output-column>
<target-field fieldId="sampling_settings" fieldName="Sampling Settings" requiredness="OPTIONAL" type="ENUMERATED">
<enumerated-field-parse-options mappingKey="NAME" />
<javascript-transform><![CDATA[
var settingsFlag = record.survey_type;
if (settingsFlag != 'null')
{return "Sampler 1"; }
{ return "Sampler 2"; }
]]></javascript-transform>
</target-field>
</output-column>Quota properties
- Quota Rule Name
- Unique name of the Quota Rule that appears in the Quota Rule list and in the Quota Processing report. In this example report, the name is “Target-35”.
- Priority
- Where the quota appears in the list relative to other quotas.
- Unit/Unit Group
- Unit or Unit Group (segment) this quota applies to. A rule applies to all Units in the group.
- Completed Survey Target
- Count of responses from invitations sent during the Timeperiod (responses received after the period are included as long as the invitation was sent in the time period.) Leave empty for unlimited.
- Timeperiod
- Time period in which to send invitations and track the count of responses. The choices are Monthly, Quarterly, or Yearly, using the Gregorian calendar.
- Survey Sampling Setting
- (required) The Sampler that uses this quota rule. Samplers can have multiple Quota rules to achieve different rates for distinct Units or Unit Groups.
Randomizing Invitation emails
The importer processes records and passes them to Sampling in the order they arrive or appear in the imported file. As such, records are the beginning of the file are more likely to receive invitations than ones later when using quotas. If this is problematic, randomize the records before they arrive to the Quota stage, by adding randomizeSamplingRecordsOrderForQuota to the importer specification as follows:
<survey-processor-options randomizeSamplingRecordsOrderForQuota="true"
samplingOperation="SEND_INVITES" primaryUnitFieldID="e_company_unit"/>
Tips and best practices
- Run Sampling daily to give Experience Cloud many opportunities to adapt.
- Import just one batch of invitation emails per day to achieve consistent results.
-
Imported survey results do not affect response rate used for quota management.
- Any record whose Survey source value is 0 (INVITED) is included in the Response rate. This applies to responses from survey emails sent from Experience Cloud and to imported survey results. To exclude a record from the calculation, set the field value to 2 (EXTERNAL) before or during import.
- When the Survey sampling setting field has a value, the record only affects the response rate for those quota rules identified by the sampling setting. Otherwise, when the field is empty — and which can only happen for an imported survey result — the response applies toall quota rules for the Unit.
- Changes to a Quota settings take effect immediately and apply to all future invitations.
- Quotas are for responses from Invitation emails sent during the period, not responses received in the period. Responses arriving after the time period are included in the results as long as the Invitation email was sent during the time period.
- Quotas define targets, but there is no guarantee actual counts and quota targets matches.
- Setting the default response rate a little low is better than setting it a little high.
- The response rate statistics are company-wide. They are not calculated for individual Units.
- Quotas are for individual Units, even when defined at Unit groups.
- There's no preference given to Units falling behind (randomized).
- Samplers can have one or more Quotas rules, each used to achieve different rates for distinct Units or Unit groups.
Check Use per-unit response rate box on the Samplers screen for Quota to dynamically calculate the Response rate, which is key to correctly send the right number of Invitation emails.
When using quota as a target of the number of responses to receive, set the quota target at 10-20% higher than the value of your target. In general, quota can come in 10-20% below the target number due to fluctuations in day-to-day response rates.
