A decision algorithm for assessing indirectness in core GRADE - PubMed A decision algorithm for assessing indirectness in core GRADE

Most useful innovation in #BMJ Core #GRADE series are algoritms to take your though #riskofbias, #imprecision, and #inconsistency. But #indirectness – nothing until publication last month of an indirectness algorithm we developed after publication of the series.

pubmed.ncbi.nlm.nih.gov/41386580/

Quality Assessment of Diagnostic Test Accuracy Studies

QUADAS-3 published
pubmed.ncbi.nlm.nih.gov/41698208/

introduction of an 'ideal test accuracy trial' 👇

assessment at estimate rather than study level

introduces a judgment of #RiskOfBias regarding applicability

#Psychometrics #SysReview #RoB

QUADAS-3: A Revised Tool for the Quality Assessment of Diagnostic Test Accuracy Studies | Annals of Internal Medicine Assessing risk of bias and applicability is critical in diagnostic test accuracy reviews to ensure valid, relevant findings that can inform decision making and policy. This article introduces QUADAS-3...

QUADAS-3 was published in @annalsofim.bsky.social. Check out the latest version of the #QUADAS tool for #riskofbias assessment of diagnostic accuracy studies. www.acpjournals.org/doi/10.7326/... and www.acpjournals.org/doi/10.7326/...

A Risk of Bias assessment from a published meta-analysis. Table shows 30 studies rated on 10 criteria as 'Yes', 'Uncertain', or 'No'. The overall bias rating is taken as the worst rating across all criteria per study, so a single 'No' rating gives the study a 'High' bias. This particular meta-analysis rated all 30 studies as 'High bias'. So this exercise does not help differentiate between studies.

In #SystematicReview & #MetaAnalysis authors often do #RiskOfBias (RoB) assessments, quantifying whether included studies are 'biased'

Studies may be rated on multiple criteria as Low/Moderate/High bias. The overall RoB may then be the *maximum* level per study

This can produce tables like this:

#Cochrane #Betahistine #MenièresDisease #SystematicReview #GRADE #RiskOfBias #BMJ #EvidenceBasedMedicine #MetaAnalysis

Recent Cochrane collab Colombia Webinar: new #RiskofBias instrument for #RCTs, ROBUST-RCT @bmj.com publication this year. Talk shows how ROBUST-RCT maintains rigor while achieving user-friendliness and simplicity. Prediction: ROBUST will become the go-to #instrument.

www.youtube.com/watch?v=wFiS...

Why is neonatal evidence mainly very low or low certainty - a meta-epidemiological review of Cochrane Neonatal reviews Abstract. Objective: To analyze for which reasons the certainty of evidence was downgraded in neonatal Cochrane reviews. Methods: We performed a systematic meta-epidemiological review for Cochrane neo...

#CochraneDaily Just published! Researchers used 54 @cochrane.org neonatal reviews to investigate why #neonatal evidence is mainly very low or low certainty and found that the main reasons were imprecision and risk of bias
karger.com/neo/article/...
#RiskOfBias

Comparison between RoB-1 and RoB-2 tool and impact on network meta-analysis results – a case study from a living Cochrane review on psoriasis This study was conducted within a large Cochrane living systematic review on psoriasis treatments with the aim to evaluate the inter-rater agreement o…

Comparison between RoB-1 and RoB-2 tool and impact on #NetworkMetaAnalysis results – a case study from a living #Cochrane review on psoriasis #RiskOfBias #EvidenceSynthesis #MetaResearch www.sciencedirect.com/science/arti...

Risk of Bias Assessment of Randomized Controlled Trials: From the 1994 Cochrane Collaboration Toolkit to ROBUST‐RCT Click on the article title to read more.

#CochraneDaily Just published! Read for free this account of the history of guidance and tools for assessing risk of bias in systematic reviews by Rafael Leite Pacheco and Rachel Riera from #SaoPaolo onlinelibrary.wiley.com/doi/10.1111/...
#RiskOfBias #EvidenceSynthesis #Cochrane

GRADE guidelines: 21 part 1. Study design, risk of bias, and indirectness in rating the certainty across a body of evidence for test accuracy - PubMed Rating the certainty of a body of evidence using GRADE in Cochrane and other reviews and World Health Organization and other guidelines dealing with in TA studies helped refining our approach. The resulting guidance will help applying GRADE successfully for questions and recommendations focusing on …

If you are using #GRADE to rate #CertaintyofEvidence for diagnostic tests this article that deals with study design, #RiskofBias, and #indirectness provides crucial guidance.

pubmed.ncbi.nlm.nih.gov/32060007/

World Cerebral Palsy Day – October 6th

#CochraneDaily On #WorldCerebralPalsy Day (worldcpday.org), read this analysis of risk of bias assessments in 145 systematic reviews of interventions for cerebral palsy www.jclinepi.com/article/S089...
@jclinepi.bsky.social
#CerebralPalsy
#RiskofBias #EvidenceSynthesis

Quality and Bias in Randomized Controlled Trials Published in Latin American Nursing Journals: A Meta-Epidemiological Study - PubMed Reporting compliance and risk of bias of RCTs published in Latin American nursing journals presents significant gaps, particularly in key methodological domains. These shortcomings hinder transparency...

#CochraneDaily Just published! Study from Iberoamerican Cochrane Centre, Cochrane Ecuador and others found significant gaps in reporting compliance and #riskofbias of randomised trials published in Latin American #nursing journals
pubmed.ncbi.nlm.nih.gov/40993964/
#RoB #RCT #Cochrane
@cochrane.org

Human Versus Artificial Intelligence: Comparing Cochrane Authors' and ChatGPT's Risk of Bias Assessments Introduction Systematic reviews and meta-analyses synthesize randomized trial data to guide clinical decisions but require significant time and resources. Artificial intelligence (AI) offers a promi...

#CochraneDaily Just published! Comparison of human and #ChatGPT-4o risk of bias assessments of 84 randomized trials from 8 #Cochrane reviews concluded that the #AI tool can perform #RiskOfBias assessments using #RoB2 with fair to moderate agreement with humans onlinelibrary.wiley.com/doi/10.1002/...

Comparative assessment of Cochrane’s ROB and ROB2 in dentistry trials: a meta-research study - Systematic Reviews This meta-research study aimed to compare the assessment of Cochrane’s Risk of Bias (RoB) and RoB2 tools in dentistry trials. A sample 150 in vivo randomized clinical trials published between 2020 and...

#CochraneDaily Just published! Comparison of assessments by #Cochrane #RiskofBias and RoB2 tools in 150 dentistry trials found low agreement, highlighting potential impact on #EvidenceSynthesis and decision-making in dental research
systematicreviewsjournal.biomedcentral.com/articles/10....

#CochraneDaily Just published! Study from NHMRC Clinical Trials Centre @sydney.edu.au‬ provides guidance for using individual participant data to inform risk of bias assessments in #IPD meta-analyses
www.jclinepi.com/article/S089...
#EvidenceSynthesis
#RiskOfBias #Bias
@jclinepi.bsky.social

(PDF) Exploring the methodological quality and risk of bias in 200 systematic reviews: A comparative study of ROBIS and AMSTAR-2 tools PDF | AMSTAR-2 and ROBIS are tools used to assess the methodological quality and the risk of bias in systematic review (SRs). We applied AMSTAR-2 and... | Find, read and cite all the research you need...

AMSTAR-2 may be more appropriate when faster assessments are prioritised. ROBIS may be more appropriate when a comprehensive bias assessment is sought. #RiskOfBias #SystematicReview #EvidenceSynthesis

www.researchgate.net/publication/...

Large Language Model–Assisted Risk-of-Bias Assessment in Randomized Controlled Trials Using the Revised Risk-of-Bias Tool: Usability Study Background: The revised Risk-of-Bias tool (RoB2) overcomes the limitations of its predecessor but introduces new implementation challenges. Studies demonstrate low interrater reliability and substanti...

#CochraneDaily Just published: study of 46 randomised trials from 86 #Cochrane reviews found that Large Language Models showed strong potential for assisting humans with risk of bias evaluations using Cochrane RoB2
www.jmir.org/2025/1/e70450
#LLM
#RiskOfBias
#CochraneLibrary

Expert Review

Conducting a High-Quality Systematic Review

📖 doi.org/10.3899/jrhe...
@singingob.bsky.social ‬

#metaanalysis #riskofbias #systematicreviews

Prospective registration was associated with a reduced risk of bias for randomized controlled trials: a meta-research study To investigate the association between trial registration and the risk of bias (RoB).

Prospective registration was associated with a reduced risk of bias for randomised controlled trials: a meta-research study.

www.jclinepi.com/article/S089...

Via @jclinepi.bsky.social

#riskofbias #bias #reportingguidelines #trialregistration #clinicaltrials #research #evidence

Core GRADE 4: rating certainty of evidence—risk of bias, publication bias, and reasons for rating up certainty This fourth article in a seven part series presents the Core GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach to addressing risk of bias, publication bias, and rating...

A series of 7 papers, Core #GRADE, the essentials of GRADE providing all you need to rate #CertaintyofEvidence and move from evidence to recommendations, is currently appearing in the #BMJ. Today, dealing with #RiskofBias, publication bias, and large effects.

www.bmj.com/content/389/...

#CochraneDaily Just published! INSPECT-SR stage 2 shows feasibility and impact of clinical trial trustworthiness checks, based on 95 trials from 50 #CochraneLibrary Reviews #FairTests #RCT #TrustInResearch #EBM #EBHC #RiskOfBias @jclinepi.bsky.social www.jclinepi.com/article/S089...

Prospective registration was associated with a reduced risk of bias for randomized controlled trials: A meta-research study To investigate the association between trial registration and the risk of bias.

#CochraneDaily Just published! Meta-research study shows that prospective registration of randomised trials was associated with a reduced risk of bias www.jclinepi.com/article/S089... #RiskOfBias #RCT @jclinepi.bsky.social

The use of placebos in controlled trials of surgical interventions: a brief history. - The James Lind Library Introduction Inferences about the effects of treatments, including surgical treatments, rely on making comparisons. These comparisons may be with patient’s symptoms before a treatment has been applied...

We can think of this as an example of using a placebo to provide a fair test of surgery. If you’d like to learn about other examples of this over the last 60 years, I’ve got just the article for you: (www.jameslindlibrary.org/articles/use...) 8/8 #FairTests #RCT #DoubleBlind #RiskofBias

Reducing risk of bias in interventional studies during their design and conduct: a scoping review - BMC Medical Research Methodology Background Interventional studies are intended to provide robust evidence. Yet poorly designed or conducted studies may bias research results and skew resulting evidence. While there have been advance...

#CochraneDaily Just published! Scoping review from NHMRC Clinical Trials Centre at @sydney.edu.au of ways to reduce or predict risk of bias during the design and conduct of intervention studies found only three eligible studies bmcmedresmethodol.biomedcentral.com/articles/10....
#RiskOfBias #RCT

🖨️ Délai de #publication des résultats des #essaiscliniques

📚Mise à jour d’une revue Cochrane sur 165 135 essais

🔗Lire le résumé t.ly/GMzjE

#cochranereview #riskofbias #santépublique

ICYMI - Assessing #RiskOfBias in comparative diagnostic accuracy studies using the QUADAS-C RoB tool

TI Methods Speaker series webinar recording
👉🏽 bit.ly/3qKGfyh

Speaker: Dr. Bada Yang

#MetaResearch #researchsky #medsky

ICYMI - #ResearchMethods webinar recording!

Dr. Carole Lunny shares a new #RiskofBias tool for network meta-analysis: ti.ubc.ca/rob-nma

#researchsky #metaanalysis #systematicreviews

My interview with Eitan Agai, CEO of PICO Portal

One of two series
youtu.be/4BVigwoY1WE

Subscribe to YouTube channel & stay updated with most recent developments in field.

Sponsor: @systematicreview.bsky.social
#SystematicReview #EvidenceSynthesis #Automation #UX #Reponsible #AI #XAI #RiskofBias

The LATITUDES Network provides a library of #ValidityAssessment (AKA #RiskOfBias) tools for use in #EvidenceSyntheses such as #SystematicReviews. Researchers can register new tools and get access to training, see @jclinepi.bsky.social article: www.jclinepi.com/article/S089...

How to assess quality of evidence? Term not well defined but usually includes 3 elements: 1. Internal validity (AKA #RiskOfBias), 2. External validity, 3. Reporting quality. @latitudes-network.bsky.social deals with study validity and @equatornetwork.bsky.social aims to improve quality of reporting