Feedback
Pay results fee

Sorry, you have not enough credits to pay results fee.


Improved measurement of behaviour change within the YAL community

Status Closed Closed 2 years ago
Bounty Reward
50

Labels

Statistics Design of experiments Statistical modelling

Description

We run an edutainment HIV/AIDS portal called Young Africa Live in South Africa, Kenya and Tanzania. For more information please look at our website http://praekeltfoundation.org/young-africa-live.html.

The primary objective of what we're trying to do is to increase sexually safe and responsible behaviour in youths age 18 to 25. In addition we aim to drive positive change in the preconceptions about gender and sexuality in this audience. For the past two years we've conducted surveys on the platform to determine our users' opinion on relationship and sexual practices. The results can be seen in these two PDFs:

http://www.praekeltfoundation.org/yal_survey/YAL_YouthSexSurvey_FullResults.pdf http://www.praekeltfoundation.org/docs/YALSexSurvey2012_PollsResults.pdf

Additionally, we record web analytics of user behaviour on the platform, including page impressions, number of comments posted and top articles that people have viewed. We have dashboards that show an overview of these analytics, an example dashboard for Tanzania can be seen here. Dashboards are also available for South Africa and Kenya. It may be possible to source more in-depth data if required by a data scientist.

We are looking for suggestions about how we can improve our practices to monitor change in user behaviour over time. We're also looking for additional survey questions or data that we should be collecting that would assist us in achieving this objective, as well as any suggestions for equating online measurements with real world behaviours.

In the future we're looking to employ a statistician to help analyse our data and make ongoing suggestions about improvements that we could be making. The best answers from this "bounty" will help us determine who we'd like to employ. If you require further information or need clarification on anything, feel free to post a clarification and we'll do our best to answer it.

Answers (6)

  • AlixGodfrey
    Feb 08, 2013

    Just to give you an idea of why I am qualified to answer your questions and potentially help you out in the future here is a brief description of my background. I work as a freelance statistician dividing my time between running data analysis, usually surveys, and running training courses on statistics and SPSS. I have over 10 years experience with SPSS and statistics, although my qualifications are in social sciences. Firstly I would just like to say that your research sounds really interesting and is certainly a very worthwhile project. One thing I have noticed though is that by getting your respondents through VodafoneLive you are getting only a very restricted sample, firstly those who can afford/have the opportunity to obtain a mobile phone and, less importantly, those who choose Vodafone [although it may well be that this is the primary network in Africa, and even if not we would probably assume that the profile of those using Vodafone is not significantly different from those using other networks]. Only accessing opinions through those who have a mobile phone may be biasing your results such that you cannot infer back to the young African population as a whole. Firstly the Poll: Q1 - far too leading, first of all there should not be a maybe option, people are either sexually active or they aren't [although you could include a don't know option just in case!]. Giving those reason as to why people are or aren't sexually active is very odd and I expect will lead to many people just not answering. Q2 - this should not be a true or false, it is an opinion not a fact, I expect this is what you're getting at but it sounds like you are asking for a medical fact. Q4 - again don't have these reasons next to the answers, you have said Yes/No it is as bad as murder, so don't then have 'it is murder' and 'it is not murder'. You are either asking if it is as bad as murder or you are asking if people think it is/is not murder, confusing the two makes the answers unclear. Q8 - this is two questions asked in one, you are asking if it is rare or common and then also if it is two way street or an abuse of power, as people can't answer both you are making people decide which question to answer so the results will be largely pointless. Q9 - again people are likely to have opinions other than those you are allowing them to choose so allow an 'other' option Q12 - what exactly is this question about? The options are quite random really, and also what are people supposed to answer if they have a healthy, safe sex life? Also what if they plan on carrying a condom and not cheating anymore. Q14 - again, don't give these opinions after the yes/no/maybe, people may believe the answer is yes but for nothing to do with what you have said. Q18 - No - guys will always want to take it into the bedroom - you cannot say this it is far too leading and stereotypical, either gender may want to turn a friendship into something more. Q19 - Not sure, but i don't want anything to do with them - take out this comment, again you are just excluding people from saying not sure because being not sure has nothing to do with not wanting to have anything to do with them Q21 - firstly again the comments are a bit unecessary, also why are you saying 'as long as she's your wife' and 'how can you miss her'? Is this question meant only for males? Q23 - No, again, don't have this comment here, some people may not have been tested because they haven't had any sexual activity, because they always use protection or for many many reason. Q33 - strange question and options, what does caring for an HIV patient have to do with being old enough to have sex? This should probably just be an open question for people to say whatever they like Q43 - some people may not rely on god at all, give them this option Q47 - keep it simple, yes or no

    Sex Survey: Q3 - what about a guy who thinks sex is better with love? What about a girl who just likes sex? Q6 - Categories overlap, you have 16-18 then 18-21 which category should someone answer if they were 18? You will get unreliable results Q12 - again you are asking two questions here. How can someone answer this if they know someone who has? Surely you still want to know if their answer for themself is yes or no? Q13 - answer might be yes and they are not ina relationship now but it didn't end badly. Q15 - this is not an options questions there are so many things someone might say, just allow open ended response Q18 - you have stated 'if nothing physical happens' so then having an option of 'only if you have sex' doesn't make sense Q29 - what about i kept my baby and it was the wrong decision? Might be a sad answer but it should be an option

    I have not listed all the possible issues with this questionnaire too as I think it is important to go on to the analysis side of things, however I think both questionnaires need quite a lot of revision in order to make your results reliable.

    In terms of analysis of course you can just look at the % change over time, probably split into males and females and age groups, but it would also be interesting to go into more depth on some of the questions. At the moment I think you might be asking a few too many questions and so it would be hard to really get a focus on the issues. Although the blog/news items questions are interesting these will be changing over time and so won't be comparable and so maybe cut down on these.

    I think the dashboard could show more useful data, currently it is really just showing you the amount of traffic through the polls which may be useful but doesn't give you any overview of the data.

    In terms of analysis I think you should be looking at running association tests, chi squared being the most basic, to see if there are relationships between people views in different areas. What questions you would look at would depend on more detail about what you want to find out. In the future I think it would be good to get some scale questions in there [what is your opinion on a scale of 1-5 etc] largely because this gives much more scope for statistical analysis and you would be able to build models around what is predicting people's views on sex/HIV and so on. In the same vein as this, asking for people's actual age rather than categories would be good as then this could be used as a predictor and we could also run ANOVAs to look at whether views differ significantly depending on age. There are many directions in which this could go, and I hope to be able to work with you on this to help develop such an important project.

  • sudouest
    Feb 05, 2013

    Hi,

    I have looked into your survey. It would be better if the survey is shorter (less questions) and returning webpage visitors (with user account) can be ensured they will get new set of questions, to keep them in active participation. This also allows changes in opinion on sexual practices and AIDS be recorded and correlations over time be captured. Correlations between answers to different questions are important to understand their perceptions on HIV/AIDS, for example, to understand how they would think and react if faced a certain social situation. Normal statistics using averages does not capture them. If this is expensive, one can still use the raw data obtained from each questions and analyze their overall correlations, but it does not have the possibility to re-test/verify the conclusions obtained from the analysis, since it is a one-time only survey. These would be my suggestions.

  • Justin Kameni
    Feb 05, 2013

    According to your aims, I think that your questionnaire should help you understand the raison why youth (18-25) sexuality is not safe and why they adopt an irresponsible behavior. In my opinion there are some lacks in the questionnaire that can guide us reach our goal. Previous studies proof that sexual attitude is correlated to religion, gender, marital status, grade, residence. You don't mention some of these factors (marital status, grade) into your questionnaire. The sexual behavior is also evaluated by the number of partner over the 12 months, the number of sex over the past 7days or past 30 days. I don’t see it. Information about the obstacle to sexual abstinence, the knowledge of the target population against sexual risk, the obstacle to the condom’s use, the communication between partners about their sexuality, advantage of monogamy and one partner or faithful partner, the advantage of sexual abstinence and the advantage of the condom’s use. Your platform would probably, through these questions decide to focus on awareness of youth against the advantage of sexual abstinence and the advantage of the condom’s use. The second step of my intervention is how you can display the survey's result so people pay more attention. Statisticians proof that graph is more attractive/enticing than table. It will be useful to do cross tabulation between demographic variable (gender, marital status, grade, residence, etc.) and other variables (the condom’s use, sexual behavior, drug abuse, etc.). The cross tabulation with statistical test will drive out correlation or not among variables. Finally, multivariate analysis or statistical modeling will be done to find factors that impact the unsafe an irresponsible behavior of youth. Now that you understand the raison, you will act on these factors to increase the sexually safe and responsible behavior. Concerning your dashboards, the text are unreadable, we just see the number and percent. I propose to put the title and the link of the top five articles, increase the font size of the text so it can be readable. Display the region of the viewer too. You must specify the baseline of the comparison we just see the number increase or decrease but this increasing or decreasing is against when? Graph mining can be used to dig decision from your website users. The following organization work hard about sex youth behaviors and AIDS in Africa. I shared very well with them when I was in Africa. http://psi.org/ http://www.unfpa.org/hiv/ http://www.prb.org/ I worked with http://www.acms-cm.org/ and shared with http://www.care.org/ on some project. Don't hesitate to contact me for any question about my comment. It is a pleasure for me to help your foundation reach this important goal. Before take your decision, I would invite you to take in consideration feedback of anyone. I work for 6 clients and all were satisfied. You can read their comments. I'm quite sure you will too and if you are not your will be refunded. My goal on this platform is to help people or small business to use analytics. We help your company grow. Always satisfy! Regards

  • valentina.panetta
    Feb 07, 2013

    Hi Belinda, I read your interested work. I’ have some suggestion on the question present in the questionnaire. The first is general, try to not put comment in the possible answer, because it could to condition the responder, I mean that someone can try to search the “right” answer and not his answer. In question 3 the possible answers are separately between girl and guy but if you have gender in the interview you don’t need to specify and some guy can responder that he like to be involved, otherwise if the first answer is “ I’m girl …” no guy could say the same … Question 5 yes no I don’t’ know are the perfect answer without comment, because the first is “yes, there is no other way …” and I think Yes but there no the only way? Question 6 don’t’ put comment as too young or “!” after I’m virgin it’s easier to have good answer in this way. In some question like Question 23 and 24 I think it could be better to can choice more options, to do this you don’t need to create combination, only you can calculate frequency in another way. Generally I think that could be interested analyzed data by sex and classes of age to understand which is the subgroups to make more interventions. The questionnaire is long I suggest to create a fixed part to present every year and another part that you repeat every 3 years. So the not fixed part could be changed and you can make some question in different period. I don’t understand if there are some demographic question and if yes which are. Could be interested know if this girls and guy work or study or the socioeconomic status, religion. Also you can insert one question like: DO you think that young people need more advice on HIV? Yes no If yes which the best way to receive this advice for you?

    Have good luck

  • mpandi
    Feb 08, 2013

    Based on the program description, I thought about implementing the following: 1. Weight the questions i.e. assign a numerical value to each answer to the questions based on its correctness/near correctness. Create clusters of points that can be earned. Total cumulative points earned by each participant and place the participants in their respective clusters. 2.Correlate the questions. For example, answer A to question 1 should lead to answer B to question 2. Analyze if the participant acted in accordance to this rule. It is then easier to deduce behavior. 3.Let them retake the test after sometime. Has there been a shift in their opinion to the questions? Use innovative technologies such as knowledge management and information retrieval and machine learning to retrieve information about each participant. 4.Use clustering to put students with similar characteristics together. Using these identify any other features they share. 5.Use of cutting edge data mining, machine learning techniques for building advanced supervised learning systems. These are systems predict future behaviors based on some observed information.

  • kevin.mccormack
    Feb 15, 2013

    I have read the report on the SA Youth sex survey 2011 and the YAL 2012 . I can see that they have collected some meaningful data, however, I have a number of fundamental concerns about the results presented.

    *  age and gender details by region of respondents were not supplied, 
                                                                                                       *  proportions of questions answered  by age and gender and region,
    
    * where are the margin of error estimates  - precision estimates are required at a minimum.
    

    This type of survey should be used to monitor behavioural change as a result of national/local policy intervention programmes on areas such as HIV/AIDS, safe sex and behaviours to women and other minority groups.

    However, they do need to urgently address the issue I have raised in relation to representativeness and precision.

Comments for results
  • AlixGodfrey said:

    Hi,

    I just wanted to say thanks for choosing my answer and hope to work with you in the future.

    If you do want to contact me about future projects and analysis feel free to email me at alix.godfrey@sigmaphi.co.uk, although happy to work through Zombal.

    Good luck with your projects.

    Alix



Tips

Keep your profile up to date. The launcher will look at your qualifications, experience and feedback.

Read the zomb description carefully. Ensure you answer any queries about your skills or experience

Take a look at what other members are bidding. If you're going to place a bid amount that's higher than other members, ensure you are the best candidate!