travel to school survey: validation and testing of hands-up … · abertawe, sir gaerfyrddin) • 7...
TRANSCRIPT
![Page 1: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/1.jpg)
13th March 2019
Amy Davies; Senior Public Health Practitioner
Travel to School Survey: Validation and testing of Hands-Up methodology in primary schools in Wales
![Page 2: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/2.jpg)
•Why travel to school is important
•Why we need a travel to school survey
• Research study methodology
• Study sample and overall results
• Future of the “Travel to School Hands-Up Survey”
Session Sesiwn
20 minutes 20 munud
• Pam mae teithio i’r ysgol ynbwysig
• Pam mae angen arolwgteithio i’r ysgol
•Methodoleg astudio ymchwil
• Sampl astudiaeth ymchwil a canlyniadau cyffredinol
•Dyfodol yr “Teithio I’r YsgolArolwg Dwylo Fyny”
![Page 3: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/3.jpg)
Background Cefndir
Active travel to school Teithio gweithredol i’r ysgol
![Page 4: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/4.jpg)
• Challenges with existing data sources
• Reduction in active travel to school rates
• School level data as catalyst for action
• Heriau gyda'r ffynonellau data cyfredol
• Mae teithio gweithredol i'r ysgol yn lleihau
• Data ysgol fel sbardun ar gyfer gweithredu
Background Cefndir
Why a new survey? Pam arolwg newydd?
![Page 5: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/5.jpg)
• Hands-Up methodology in widespread use
• No evidence of validation or evaluation
• Single day versus usual measures
• Welsh language
Background Cefndir
Need for research study Angen astudiaeth ymchwil
• Mae arolygon “Dwylo Fyny” yn ddull poblogaidd
• Dim tystiolaeth o ddilysuna gwerthuso
• Diwrnod sengl yn erbynmesurau arferol
• Iaith Cymraeg
![Page 6: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/6.jpg)
• Assess the test-retest reliability and concurrent validity of the question ‘How do you normally travel to school’ by assessing the degree of agreement between pupil and parent/guardian responses.
Primary objective
• Assess the feasibility of the Travel to School Hands Up Survey methodology in a school setting
Secondary objective
• Reliability
• Validity
• Feasibility
Research elements
• Asesu dibynadwyedd a dilysrwydd y cwestiwn "sut ydych chi fel rheol yn teithioi'r ysgol?" trwy asesu graddau'r cytundebrhwng ymatebion disgyblion a rhiant / gwarcheidwad.
Amcan cynradd
• Asesu ymarferoldeb methodoleg yr arolwgmewn ysgol
Amcan uwchradd
• Dibynadwyedd
• Dilysrwydd
• Ymarferoldeb
Meysydd ymchwil
Study methodology Methodoleg astudio
Overarching Yn gyffredinol
![Page 7: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/7.jpg)
• All children participating in the study answered the Travel to School Hands Up Survey question at two time points during one day
• Chi squared – Fisher’s Exact Test: used to determine any statistical significance between the children’s morning and afternoon responses
• Gofynnwyd i bob plentyn a gymerodd ran yn yr astudiaethgwestiwn yr arolwg ddwywaithmewn un diwrnod
• Chi squared – Fisher’s Exact Test: penderfynu ar arwyddocâd ystadegolrhwng ymateb plant i'r arolwg yn y bore ac yn y prynhawn
Study methodology Methodoleg astudio
Reliability Dibynadwyedd
![Page 8: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/8.jpg)
• Child-parent dyads recruited
• Children’s responses were compared with those of their parent/guardian
• Kappa statistic:used to determine concurrent validity by assessing the strength of agreement between pupil and parent/guardian responses
• Parau plant-rhiant wedi'u recriwtio
• Cymharwyd ymatebion plant â rhaieu rhiant / gwarcheidwad
• Kappa statistic: penderfynu dilysrwydd trwy asesucryfder y cytundeb rhwng ymatebionplant a rhiant / gwarcheidwad
Study methodology Methodoleg astudio
Validity Dilysrwydd
![Page 9: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/9.jpg)
School staff were part of a process evaluation
• Classroom observation – qualitative thematic analysis of researcher narratives
• Teacher questionnaires
• Assessment of study implementation processes
Roedd staff yr ysgol yn rhan o werthusiad proses
• Arsylwi yn yr ystafell ddosbarth -dadansoddiad thematig ansoddol o ddarluniau ymchwilwyr
• Holiaduron athrawon
• Asesu prosesau gweithredu astudio
Study methodology Methodoleg astudio
Feasibility Ymarferoldeb
![Page 10: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/10.jpg)
• 13 primary schools (Gwynedd, Swansea, Carmarthenshire)
• 7 Welsh medium and 6 English medium
• 704 pupils: child-child reliability
• 283 successful child-parent dyads:concurrent validity
• 65 classroom observations
• 27 teacher questionnaires
• 13 ysgol gynradd (Gwynedd, Abertawe, Sir Gaerfyrddin)
• 7 cyfrwng Cymraeg a 6 cyfrwngSaesneg
• 704 o ddisgyblion: dibynadwyeddplentyn-plentyn
• 283 parau plant-rhiant: dilysrwydd
• 65 arsylwi yn y dosbarth
• 27 o holiaduron athrawon
Study sample Sampl astudiaeth ymchwil
![Page 11: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/11.jpg)
• No significant difference in the proportions of children reporting each travel mode morning and afternoon (p=0.913)
• Reliability not affected by the child’s age, or by the language medium of survey delivery
• Dim gwahaniaeth arwyddocaol yn y cyfrannau o blant sy'n adrodd am bob dull teithio bore a phrynhawn(p=0.913)
• Ni effeithiwyd ar ddibynadwyeddgan oedran y plentyn, neu gangyfrwng iaith yr arolwg
Overall results Canlyniadau cyffredinol
High reliability Dibynadwyedd uchel
![Page 12: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/12.jpg)
• Strength of agreement between child and parent/guardian responses was good
(k value 0.73; CI [0.65, 0.82])
• Language medium of the school does not affect results
• Slightly greater strength of agreement for Year 5 than for Year 3 – not statistically significant
• Roedd cryfder y cytundeb rhwngymatebion plentyn a rhiant / gwarcheidwad yn dda
(k value 0.73; CI [0.65, 0.82])
• Nid yw cyfrwng iaith yr ysgol yneffeithio ar y canlyniadau
• Cryfder ychydig yn fwy o gytundebar gyfer Blwyddyn 5 na Blwyddyn 3 - nid yn ystadegol arwyddocaol
Overall results Canlyniadau cyffredinol
Very-good / good validity Dilysrwydd da iawn / da
![Page 13: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/13.jpg)
• Administration is feasible in a classroom setting.
• 78% of teachers agree that an annual survey is a worthwhile activity.
• Time efficient: 6 minutes (median)
• Important elements:
o classroom environment
o teacher preparation & delivery
o children’s understanding & response
• Mae gweinyddu'r arolwg ynymarferol mewn ystafell ddosbarth
• Mae 78% o athrawon yn cytuno bod arolwg blynyddol yn weithgareddgwerth chweil
• Amser effeithlon: 6 munud (canolrif)
• Themâu pwysig:
o amgylchedd dosbarth
o paratoi athrawon a sut maen nhw'ngweinyddu
o dealltwriaeth ac ymateb y plant
Overall results Canlyniadau cyffredinol
Feasible to deliver Ymarferol i'w wneud
![Page 14: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/14.jpg)
• Refine tools and methodology
• School led activity each September
Establishment of annual “Travel to School Hands-Up Survey”
• Testing scalability and local delivery structures
Phased implementation
Using data to promote healthy behaviours
Gweithredu fesul cam
• Mireinio offer a methodoleg• Gweithgaredd dan arweiniad yr ysgol - bob
mis Medi
“Teithio I’r Ysgol Arolwg DwyloFyny” blynyddol
• Profi graddfa a strwythurau gweinyddulleol
Defnyddio data i hyrwyddoymddygiad iach
Conclusion Casgliad
Future of the survey Dyfodol yr arolwg
• Information for local planning, action and evaluation
• Contribution to Curriculum: Health and Wellbeing Area of Learning and Experience
• National scheme requirements
• Gwybodaeth ar gyfer cynllunio, gweithredua gwerthuso lleol
• Cyfraniad I cwricwlwm newydd: MaesDysgu a Phrofiad Iechyd a Lles
• Gofynion y cynllun cenedlaethol
![Page 15: Travel to School Survey: Validation and testing of Hands-Up … · Abertawe, Sir Gaerfyrddin) • 7 cyfrwng Cymraeg a 6 cyfrwng Saesneg • 704 o ddisgyblion: dibynadwyedd plentyn-plentyn](https://reader036.vdocument.in/reader036/viewer/2022071508/612912376ecef71dbf5b4d63/html5/thumbnails/15.jpg)
Thank you DiolchQuestions? Cwestiynau?