Skip to main content

https://food.blog.gov.uk/2021/06/29/weighing-the-evidence-a-new-framework-for-assessing-external-evidence/

Weighing the evidence – a new framework for assessing external evidence

Posted by: , Posted on: - Categories: Science

As a member of the Food Standards Agency’s independent Science Council, I help to provide expert strategic insight and advice to the FSA on their use of science to deliver their objectives.

The FSA is an agency that bases its decisions of the best science and evidence, commissioning reports and performing risk assessments to better understand and make risk management decisions on various food and feed issues. Sometimes, independent evidence is sent to them outside of their standard research and consultation processes. This uncommissioned third-party evidence might be submitted with a range of motivations and aims, such as filling a perceived gap in knowledge or suggesting a change relevant to a policy or legislation.

The Science Council was asked by the FSA Chair to look at how to consistently evaluate this type of third party evidence and make clear the standard expected to those who wanted to submit. In response, we developed and published a framework for the critical appraisal of this type of evidence.

I’m pleased to say the FSA has adopted the Science Council’s guidance and will use it to help them assess evidence and in their engagement with others. In line with the FSA’s commitment to openness and transparency, it’s publicly available on the FSA’s website to those who want to submit evidence for consideration.

The purpose of the guidance

The guidelines outline the expectations concerning the standard of evidence that the FSA receives and provides guidance on how its strengths and weaknesses will be assessed according to core principles of quality, trust and robustness.

Consideration of how evidence performs against these principles and guidance will help those preparing a useful contribution to the relevant body of evidence.

When new advice on food safety is required, our risk analysis process will be used to assess the risk, consider the measures that could be taken, and communicate the risk and necessary actions with others.

When we receive evidence, we will:

  • be transparent about how the evidence is assessed and used to develop our evidence base, policy recommendations and risk communication
  • assess evidence in its proper context using the principles of quality, trust and robustness
  • seek to minimise bias in our assessments of evidence by using professional protocols, our Scientific Advisory Committees, peer review and/or multi-disciplinary teams
  • be open and transparent about the conclusions we have reached about any evidence submitted to us

What we mean by the principles of quality, trust and robustness

The Science Council’s guidance explains their interpretation of these principles in more detail but briefly:

  • Quality evidence is clearly presented, reliable and relevant to the question at hand and conclusions drawn
  • Trustworthy evidence is transparent about its limitations, uncertainties and potential sources of bias and how impartiality has been minimised
  • Robust evidence includes consistent observations, considered from several perspectives

Other guidance available on submitting evidence to the FSA

The Science Council's framework is intended to help the FSA’s engagement with others who have or may submit uncommissioned evidence. The framework is intended to complement our risk analysis process. However, evidence required to place a regulated product on the market is separate, and subject to specific guidance.

Tafoli’r dystiolaeth – fframwaith newydd ar gyfer asesu tystiolaeth allanol

Fel aelod o Gyngor Gwyddoniaeth annibynnol yr ASB, rwy’n helpu i roi mewnwelediad strategol a chyngor i’r ASB ynghylch ei defnydd ar wyddoniaeth i gyflawni ei hamcanion.

Mae’r ASB yn asiantaeth sy’n seilio ei phenderfyniadau ar y dystiolaeth wyddonol orau, gan gomisiynu adroddiadau a chynnal asesiadau risg i ddeall amrywiol faterion bwyd a bwyd anifeiliaid yn well a gwneud penderfyniadau rheoli risg yn eu cylch. Weithiau, anfonir tystiolaeth annibynnol atynt y tu allan i’w prosesau ymchwilio ac ymgynghori arferol. Gallai’r dystiolaeth hon gan drydydd parti sydd heb ei chomisiynu gael ei chyflwyno gydag ystod o gymhellion a bwriadau, megis llenwi bwlch ymddangosiadol mewn gwybodaeth, neu awgrymu newid sy’n berthnasol i bolisi neu ddeddfwriaeth.

Gofynnodd Cadeirydd yr ASB i’r Cyngor Gwyddoniaeth edrych ar sut mae gwerthuso’r math hwn o dystiolaeth gan drydydd parti mewn modd cyson, a gwneud y safon ddisgwyledig yn glir i’r rheiny sydd am gyflwyno tystiolaeth. Mewn ymateb i hyn, fe wnaethom ddatblygu a chyhoeddi fframwaith ar gyfer tafoli’r math hwn o dystiolaeth yn feirniadol.

Rwy’n falch o ddweud bod yr ASB wedi mabwysiadu canllawiau’r Cyngor Gwyddoniaeth, a byddant yn eu defnyddio i asesu tystiolaeth, ac wrth ymgysylltu ag eraill. Yn unol ag ymrwymiad yr ASB i fod yn agored ac yn dryloyw, maent ar gael yn gyhoeddus ar wefan yr ASB i'r rheiny sydd am gyflwyno tystiolaeth i'w hystyried.

Diben y canllawiau

Mae'r canllawiau'n amlinellu'r disgwyliadau o ran safon y dystiolaeth sy’n dod i law’r ASB, ac yn cynnig arweiniad o ran sut bydd ei gryfderau a’i gwendidau yn cael eu hasesu yn unol â’r egwyddorion craidd, sef ansawdd, ymddiriedaeth, a chadernid.

Bydd ystyried sut mae tystiolaeth yn perfformio yn erbyn yr egwyddorion hyn yn helpu’r rheiny sy’n paratoi cyfraniad defnyddiol i’r corff tystiolaeth perthnasol.

Pan fydd angen cyngor newydd ar ddiogelwch bwyd, bydd ein proses dadansoddi risg yn cael ei defnyddio i asesu'r risg, ystyried y mesurau y gellid eu cymhwyso, a chyfathrebu'r risg a'r camau angenrheidiol gydag eraill.

Pan fydd tystiolaeth yn dod i law, byddwn yn:

  • dryloyw o ran sut mae'r dystiolaeth yn cael ei hasesu a'i defnyddio i ddatblygu ein sylfaen dystiolaeth, argymhellion polisi a chyfathrebu risg
  • asesu tystiolaeth yn ei chyd-destun priodol gan ddefnyddio egwyddorion ansawdd, ymddiriedaeth a chadernid;
  • ceisio lleihau rhagfarn yn ein hasesiadau o dystiolaeth trwy ddefnyddio protocolau proffesiynol, ein Pwyllgorau Cynghori Gwyddonol, adolygu gan gymheiriaid a/neu dimau amlddisgyblaethol
  • agored ac yn dryloyw o ran ein casgliadau mewn perthynas ag unrhyw dystiolaeth a gyflwynir i ni

Yr hyn a olygwn wrth egwyddorion ansawdd, ymddiriedaeth a chadernid

Mae canllawiau'r Cyngor Gwyddoniaeth yn egluro eu dehongliad o'r egwyddorion hyn fanylach ond yn gryno:

  • Mae tystiolaeth o ansawdd wedi'i chyflwyno'n glir, yn ddibynadwy ac yn berthnasol i'r cwestiwn dan sylw a’r casgliadau y deuir iddynt
  • Mae tystiolaeth y gellir ymddiried ynddi yn dryloyw ynghylch ei chyfyngiadau, ansicrwydd a ffynonellau tuedd posib, a sut yr aed ati i leihau tuedd
  • Mae tystiolaeth gadarn yn cynnwys arsylwadau cyson, wedi eu hystyried o sawl safbwynt

Canllawiau eraill ar gyflwyno tystiolaeth i’r ASB

Bwriad fframwaith y Cyngor Gwyddoniaeth yw helpu ymgysylltiad yr ASB ag eraill sydd wedi, neu a allai, gyflwyno tystiolaeth heb ei chomisiynu. Bwriad y fframwaith yw ategu ein proses dadansoddi risg. Fodd bynnag, ar wahân y mae’r dystiolaeth sydd ei hangen i roi cynnyrch a reoleiddir ar y farchnad, ac mae’n ddarostyngedig i ganllawiau penodol.

Sharing and comments

Share this page

Leave a comment

We only ask for your email address so we know you're a real person

By submitting a comment you understand it may be published on this public website. Please read our privacy notice to see how the GOV.UK blogging platform handles your information.