To improve our monitoring, evaluation and learning, Shooting Touch uses a variety of methods to collect information:
Participation (practice)- As a quantitative measure, attendance is taken at each court by our coaches for all program members attending practice to determine drop out rate of players and whether they are attending all health and basketball lessons. The target is to ensure that players are attending at least 80% of the programming.
Participation (family day Rwanda)- Additionally, we determine whether men are supporting women’s programming by attending family days and whether women/females feel comfortable attending with the men in their lives. Our coaches collect information of the males in attendance. We are aiming that 50% of women (in the first family day) will be able to bring a male in their lives.
Surveys - Our main platform for collecting surveys is through Commcare, which is a mobile device-surveying app. Before the surveys are conducted, each field staff member is trained on the information in the survey. They then go from site to site, surveying each demographic before and after implementation of each project, or as a follow up/annually (depending on the project). They survey a random selection of boys, girls, and women from each of our locations to ensure we can confidently make statements about those we serve. We then are able to indicate change through changes in responses pre and post programming.
Rosengburg survey and Questionnaires - In order to determine self-esteem and impact of female empowerment curriculum, the participants will fill out the Rosenburg Self-Esteem scale and a questionnaire pre and post programming for 30 girls aged 16-18 years old. This will help indicate whether the training was effective and changes that need to be made for the coming years. This will also help to address the question of whether any of these girls have grown to the point of bringing this education back to their teammates at their respective courts.
Field Group Discussion- To gather more detailed information, focus group discussion are held in a semi-structured setting. These are conducted pre and post implementation of programming. Indicators that programming is successful in focus groups are based on participants reports.
% of people tested & insured (Rwanda)- To show that there has been a reduction in stigmatizing against STD testing, we are aiming that at least 80% of females and males (above the age of 15) and women in the program are being tested annually. We are also aiming that 100% of our participants and family members have health insurance. Each person who is registered for insurance or tested will be kept in a database and analyzed on an annual basis.
Oral Testing- In order to determine retention, Rwanda programming holds oral education tests pre and post health education for all participants. A positive % change from all participants will indicate whether the information was retained.
Home Visits (Rwanda)- Home visits are conducted annually. These visits will be semi-structured while also filling out a standard report form based on observation (i.e mosquito protection nets, water sanitation, etc.). The observational changes in homes will indicate whether the health lessons and initiatives are being put into practice and conversation/interview will determine whether programming is meeting the needs of participants.
Physical Examination (Boston)- Participants receive a participation physical examination (PPE) annually. The PPE checks for possible disease, identify and medical concerns and ensure that participants are maintaining a healthy diet and exercise routine. Body Mass Index (BMI) will be measure as a part of the PPE to track health status of participants.
Observation Records (Boston)- Coaches report of perception of participants social skills (leadership, confidence, self-esteem, teamwork, etc.) to determine if there is improvement over time.
All M&E strategies are conducted with a 95% confidence level and a 10 confidence interval of 10.