Analysis of Parameter: Assignment Rule Abandonment Enforcers (a2)

Outline of the report

This automated report is divided into three sections, one for each failure condition.

Failure Condition 1 analyses the relation between the parameter: Assignment Rule Abandonment Enforcers (a2), and the probability that the simulation resulted in no change, i.e. no reduction in the rate of FGM.

Failure Condition 2 analyses the relation between the parameter: Assignment Rule Abandonment Enforcers (a2), and the probability that the simulation resulted in negative spillover, i.e. the number of people abandoning at the end of the simulation is less than the number initially targeted by the intervention.

Failure Condition 3 analyses the relation between the parameter: Assignment Rule Abandonment Enforcers (a2), and the probability that the simulation only resulted in partial change, i.e. some people carried on practicing FGM at the end of the simulation.

The analysis used depends on whether the parameter is continuous or discrete

What to Expect: When the parameter is continuous

The first part of the analysis involves a technique called Monte Carlo Filtering (see Saltelli et al., who are cited in the thesis). In essence, this tests whether the cumulative distribution of the parameter varies between the situations where the failure scenario occurs and the situations where the failure scenario doesn’t occur. If it does, then this can be taken as an indication that the parameter has a marginal effect on the probability of the failure scenario. The test used to establish the difference is the KS-Test (with alpha set at 0.01)

The second part of the analysis involves a polynomial regression of the failure scenario on the parameter in question. This model is specified as

\[[Failure-Condition] = \beta_0 + \beta_1 [intervention-size] + \beta_2 [parameter] + \beta_3[parameter]^2 + \beta_4[parameter]^3 + \epsilon\] If one or more of the beta coefficients on the parameter is significant, this may indicate a relation between the parameter and the outcome.

The third part of the analysis is a visualization of the relation between the parameter value and the probability of the outcome, assuming an intervention of size 50%, based on the polynomial regression model.

What to Expect: When the parameter is discrete

When the parameter is discrete, the first part of the analysis is tabular. The simulation results are divided into groups based on intervention size, the groups are:

  1. All Interventions
  2. Intervention size \(\leq\) 25%%
  3. Intervention size > 25% and \(\leq\) 50%

For each group, the discrete parameter is cross-tabulated with the failure condition, to give a probability that the failure condition occurred under each parameter value.

Next, a regression model is reported. This model has the following specification:

\[[Failure-Condition] = \beta_0 + \beta_1 [intervention-size] + \beta_2 [parameter] + \beta_2[parameter]\cdot[intervention-size]\] It reports the main effects of the discrete parameter (controlling for intervention size), as well as potential interactions with the intervention size.

Next, a plot shows a linear visualization of the relationship between intervention size and the probability of the failure condition. A new gradient is fit for each discrete value of the parameter, allowing the viewer to visualize the main effects of the parameters (i.e. changing intercept of the line) and possible interactions with intervention size (i.e. changing gradient of the line)

Results for No Change (Failure Condition 1)

Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 1 (All Simulations)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 1
1 zealots 7967 0.13
2 random 8067 0.13
3 high-authority 7966 0.14
Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 1 (Intervention Size <= 25%)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 1
1 zealots 2561 0.17
2 random 2635 0.18
3 high-authority 2565 0.19
Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 1 (Intervention Size > 25% and <= 50%)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 1
1 zealots 2047 0.12
2 high-authority 2054 0.12
3 random 2068 0.13
Regression Model of Failure Condition 1 as a function of Assignment Rule Abandonment Enforcers (a2)
Dependent variable:
Failure Condition 1
initial-target-proportion -0.128***
(0.013)
Assignment Rule Abandonment Enforcers (a2)random -0.002
(0.010)
Assignment Rule Abandonment Enforcers (a2)zealots -0.018*
(0.010)
initial-target-proportion:Assignment Rule Abandonment Enforcers (a2)random -0.003
(0.018)
initial-target-proportion:Assignment Rule Abandonment Enforcers (a2)zealots 0.019
(0.018)
Constant 0.193***
(0.007)
Observations 24,000
R2 0.011
Adjusted R2 0.011
Residual Std. Error 0.337 (df = 23994)
F Statistic 53.427*** (df = 5; 23994)
Note: p<0.1; p<0.05; p<0.01

Results for Negative Spillover (Failure Condition 2)

Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 2 (All Simulations)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 2
1 zealots 7967 0.34
2 random 8067 0.35
3 high-authority 7966 0.35
Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 2 (Intervention Size <= 25%)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 2
1 zealots 2561 0.33
2 random 2635 0.34
3 high-authority 2565 0.36
Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 2 (Intervention Size > 25% and <= 50%)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 2
1 high-authority 2054 0.31
2 zealots 2047 0.32
3 random 2068 0.32
Regression Model of Failure Condition 2 as a function of Assignment Rule Abandonment Enforcers (a2)
Dependent variable:
Failure Condition 2
initial-target-proportion 0.044**
(0.018)
Assignment Rule Abandonment Enforcers (a2)random -0.013
(0.014)
Assignment Rule Abandonment Enforcers (a2)zealots -0.014
(0.014)
initial-target-proportion:Assignment Rule Abandonment Enforcers (a2)random 0.018
(0.026)
initial-target-proportion:Assignment Rule Abandonment Enforcers (a2)zealots -0.006
(0.026)
Constant 0.333***
(0.010)
Observations 24,000
R2 0.001
Adjusted R2 0.001
Residual Std. Error 0.475 (df = 23994)
F Statistic 5.326*** (df = 5; 23994)
Note: p<0.1; p<0.05; p<0.01

Results for Partial Change (Failure Condition 3)

Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 3 (All Simulations)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 3
1 random 8067 0.87
2 zealots 7967 0.87
3 high-authority 7966 0.88
Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 3 (Intervention Size <= 25%)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 3
1 random 2635 0.94
2 zealots 2561 0.95
3 high-authority 2565 0.95
Cross Tab: Assignment Rule Abandonment Enforcers (a2)by Failure Condition 3 (Intervention Size > 25% and <= 50%)
Value of Assignment Rule Abandonment Enforcers (a2) N Probability of Failure Condition 3
1 high-authority 2054 0.90
2 zealots 2047 0.90
3 random 2068 0.90
Regression Model of Failure Condition 3 as a function of Assignment Rule Abandonment Enforcers (a2)
Dependent variable:
Failure Condition 3
initial-target-proportion -0.241***
(0.013)
Assignment Rule Abandonment Enforcers (a2)random -0.007
(0.009)
Assignment Rule Abandonment Enforcers (a2)zealots -0.0001
(0.009)
initial-target-proportion:Assignment Rule Abandonment Enforcers (a2)random 0.007
(0.018)
initial-target-proportion:Assignment Rule Abandonment Enforcers (a2)zealots -0.006
(0.018)
Constant 0.984***
(0.007)
Observations 24,000
R2 0.044
Adjusted R2 0.044
Residual Std. Error 0.323 (df = 23994)
F Statistic 220.798*** (df = 5; 23994)
Note: p<0.1; p<0.05; p<0.01