As of the 20z3-Z024 admission cycle, the standard Casper test is composed of 14 sections (6 video response sections and o typed response sections): • Each section contains either a word-based or video-based scenario followed by e 3 second reflection period, and then a set of open-ended questions to which the applicant must respond in the designated format. • Each video response section contains 2 open-ended questions, and each typed response section contains 3 open-ended questions. • In video response sections, applicants are given 1 minute to record a response to each question. • In typed response sections, applicants are given 5 minutes total to answer all 3 questions. * Casper typically takes between 90-110 minutes to complete, with two optional breaks: • An optional 10-minute break after the video response section • An optional 5-minute break after the first 5 scenarios in the typed response section

Students are required to answer questions orally, on video, via the #AcuityInsights platform.

The 3 second “reflection” time for answering questions is designed to produce a high-stress situation. Certainly students with (test) anxiety will be disadvantaged.

Again

"Twelve of Canada's 17 medical schools rely on the #CasperTest as part of the initial admissions process, many putting a lot of weight on an applicant's score — up to 30 per cent in some cases"

+ other programs @ other kinds of schools in Canada do too

#AcuityInsights #UniversityAdmissions

Applicants are never told their #Caspertest score

#AcuityInsights only sends that information to the schools

"Instead, test takers are told which of 4 tiers they fall into, from highest to lowest relative to other people taking the test at the same time"

#AcuityInsights promised raters could earn $30 to $50 an hour rating school applicants' #CasperTest

The company also said its raters "have differing levels of qualification" which ensures "they represent the patient population students will serve when they become physicians." 🙄 #Pfft #SusAF

Who is rating school applicants' #CasperTest ?

An online job posting for raters posted by #AcuityInsights did not list any academic/professional requirements & noted "applicants from all walks of life" were welcome and raters would get paid 65¢/per written answer assessed & $1/per video response

#AcuityInsights has also successfully marketed #CasperTest to other programs across #Canada — from #Nursing, #Dentistry and #PhysicalTherapy to undergraduate programs such as the #UniversityOfAlberta 's #BachelorOfEducation program and the #UniversityOfWesternOntario 's #Engineering school

THIS shit is what 12 of Canada's 17 medical schools are relying on when they use the #CasperTest by #AcuityInsights as part of their initial admissions process, many putting a lot of weight on an applicant's score — up to 30 per cent in some cases

#WTF #TryRelyingOnActualScienceInstead

#AcuityInsights later sent more research, but some studies were duplicates they'd already sent, several were research papers — not peer-reviewed studies — and one was a student's doctoral thesis

#CasperTest

-most of the studies were small enough to be scientifically questionable & hadn't been replicated

- & several of the studies are potentially "conflicted" because they were authored by co-founders of the company that is now Acuity or researchers that work for them

#AcuityInsights #CasperTest

Of the 8 studies cited by #AcuityInsights :

-1 doesn't examine their actual #CasperTest

-1 is an overview of existing research and does not provide any new data

-2 were conference papers, so did not undergo peer review process

-several did not address long-term outcomes

and...

Canadian universities increasingly relying on admissions test which experts say lacks evidence | CBC News Most Canadian medical schools are screening future physicians with something called the Casper test — marketed as being able to assess people skills and predict future success. But critics say there’s...

Canadian universities increasingly relying on admissions test which experts say lacks evidence

Expert established researchers with experience in medical school admissions called the research behind the test weak and insufficient to back the company's claims

#CasperTest #AcuityInsights

The company behind the test, Acuity Insights, claims the Casper helps schools predict which students will have career success by assessing "soft skills" — from empathy and ethics to judgment and communication. "They'd say, 'This company that we're looking to invest in has a reputation of [not believing in] climate change,'" he said. "You're supposed to weigh both sides of the scenario." Go Public has heard from over two dozen medical school applicants who also have concerns. "The process is unnecessarily opaque," wrote one, who said he'd taken the test five times before finally getting accepted to a medical school. A student who said he'd taken the test four times wrote that it should "be abolished." The company charges applicants $50 to write the test, and another $18 to submit to each medical school. Applicants question training of people who rate Casper exams. A recent online job posting by Acuity promised raters could earn $30 to $50 an hour. The ad did not list any academic or professional requirements, noting that "applicants from all walks of life" were welcome and raters would get paid 65 cents for every written answer they assess and $1 for every video response. Acuity told Go Public it monitors how quickly raters are scoring responses "to ensure they are spending an appropriate amount of time reviewing the context of each response." The company also said its raters "have differing levels of qualification" which ensures "they represent the patient population students will serve when they become physicians." Studies 'weren't very good' But perhaps the biggest concern is criticism from respected academics who say there is no compelling evidence the test does what it claims. pseudoscience: 🇨🇦 Controversial admissions test which experts say lacks evidence https://www.cbc.ca/news/gopublic/casper-test-medical-school-1.7507308 Critics say claims that Casper predicts student performance are unsubstantiated #Casper #AcuityInsights #pseudoscience

pseudoscience: 🇨🇦 Controversial admissions test which experts say lacks evidence
www.cbc.ca/news/gopubli...
Critics say claims that Casper predicts student performance are unsubstantiated

#MCAT #PsychologyTesting #Casper #AcuityInsights #bias #pseudoscience #AlgorithmicBias