CERIC vs. the Machine
I asked an AI whether college is still worth it. Its answer was fluent, confident, and full of holes. Here’s how to find them.
Ask a GenAI machine the most expensive question a family ever types—Is college still worth it?—and it answers in seconds, in full paragraphs, with footnotes. Mine did. The reply was calm, balanced, and wrong in ways that take a great deal longer to find than they took to generate.
This is the third piece in a series that began when I argued the old college model is dead. Earlier this week I promised you a method for taking an argument apart. Here it is.
The method has a name: CERIC, which stands for Claim, Evidence, Reasoning, Implications, and Context. It was built for reading scientific papers, but it works just as well on anything a chatbot zaps out. In five simple elements, we can watch output come apart.
So I gave a free GenAI chatbot—the one built into Google search—the question millions of families are typing right now: “Is college still worth it today?” Here is its answer, verbatim.
Yes, a bachelor’s degree remains an excellent return on investment for most students. Graduates outearn non-graduates significantly, enjoy higher employment rates, and gain access to robust benefits like health insurance and retirement plans. However, the payoff depends heavily on your choice of major, school costs, and personal career goals. [1, 2, 3]
The value of a college degree hinges on several key factors:
The Financial Advantage
The Earnings Gap: Bachelor’s degree holders typically earn over $1 million more in median lifetime earnings compared to those with only a high school diploma.
The College Wage Premium: In California, the median annual wage for a bachelor’s degree holder is $96,000—double the median wage for high school graduates.
Job Security: College graduates are significantly less likely to experience unemployment, even during economic downturns. [4, 6]
The Catch: Not All Degrees Are Created Equal
Majors Matter: Fields like computer science, engineering, and nursing offer high starting salaries and strong demand. Conversely, majors in the arts or humanities may have lower median earnings, though they develop highly adaptable critical thinking and communication skills.
Debt: Excessive student loan debt can quickly neutralize the financial advantages of a degree. Online consensus emphasizes the importance of minimizing debt by exhausting grants, scholarships, and considering community college transfer programs. [3, 8, 9, 10, 11]
When College May Not Be the Best Path
If taking on high debt for a general major doesn’t appeal to you, there are highly lucrative alternatives:
The Trades: You can bypass student debt and earn excellent livable wages in skilled trades such as plumbing, welding, carpentry, or electrical work.
Certifications & Academies: Police academies, fire science programs, and specialized tech bootcamps can launch you into high-paying, stable careers much faster than a traditional four-year program.
Military Service: The armed forces provide career training, healthcare, and GI Bill benefits that can fund further education later in life. [13, 14, 15, 16]
If you decide to pursue higher education, maximize your return on investment by starting at an affordable community college to knock out general education requirements, and focusing on high-demand fields. Researching projected career demand and regional salary averages using the Bureau of Labor Statistics can help ensure your time and tuition translate into a strong financial and professional future. [3, 9, 17]
AI can make mistakes, so double-check responses.
C — What’s the claim?
Strip the hedges, and the claim is plain: college is a good financial investment for most students. A confident “Yes” up top, then the retreat. The payoff “depends heavily” on major, cost, and goals; a later section lists when college isn’t the path at all. The bold verdict is defended only until you press it, then falls back to ground that can’t be wrong—a motte-and-bailey, for you logic lovers.
But the real move came one word earlier. The question was whether college is worth it. The machine quietly swapped worth for return on investment. That’s the swap to watch: not a false claim, a substituted one. Everything downstream defends the cheaper question.
So whether college makes you a better thinker, citizen, or human survives only as a footnote: arts and humanities majors “develop highly adaptable critical thinking and communication skills,” which the answer immediately prices as a low-value workplace asset. The civics case wasn’t deleted. It was financialized.
And mind the quantifiers. Every figure is a median or an average—the middle of the pack, not the share of students for whom college actually pays off. “For most” is an unearned jump from central tendency to proportion.
E — What’s the evidence?
Three kinds of numbers, all for four-year graduates: a $1M lifetime gap, a $96K California wage (double the high-school median), and lower unemployment. Check them, and they mostly hold. PPIC really does report the $96K as a doubling, and the $1M lifetime gap is, if anything, conservative next to Georgetown’s estimate nearer $1.2 million.
But look at the framing. It calls college “an excellent return on investment” while supplying only the return. The investment—tuition, time, interest—is missing until “debt” turns up late, as a caveat. You can’t certify a ratio from its denominator alone. The $96K is one state’s figure (California), quietly drafted to back a nationwide verdict. The “robust benefits like health insurance and retirement plans” belong to particular jobs, not to the diploma, and arrive uncited. Plenty of plumbers have both.
And those earnings come from people who finished college decades ago, before AI began reshaping the entry-level market this year’s applicant is about to enter. The evidence looks genuine. It’s also dated, gross rather than net, and silent on the automation already moving through the labor market—a $1M headline never once set against four years of forgone wages and loan interest. Past performance, no disclaimer about future results.
R — Does the reasoning hold?
The core inference is: graduates earned more; therefore, college caused the earnings. That’s the oldest confound in education research: selection bias. The second inference was it paid in the past, so it’ll pay in the future. That’s extrapolation—inductive over-reach, for you logic lovers—and it assumes the future shows up shaped like the past.
Some of the premium is the degree; some is just who earns one. People who finish college differ from people who don’t in ways that move earnings on their own. And the premium describes only the finishers: roughly a third who enroll never complete, many carrying debt and no degree, a risk the average quietly erases.
Then the answer refutes its own headline. It admits debt “can quickly neutralize the financial advantages of a degree.” Yet, most students borrow. “Excellent ROI for most” and “advantage neutralized” cannot both stand. It switches yardsticks, too, judging college by lifetime earnings while selling the alternatives as “much faster” to enter. Its closing advice to “maximize your return on investment” simply assumes the ROI frame the question never granted.
I — What follows if it’s true?
Okay, let’s hypothetically grant the core argument (CER). What logically follows? That past graduates of past colleges earned a premium. It would not follow that the college you’re weighing, at the price you’ll pay, in the market your graduating year meets, is worth it.
The biggest implication lurks in the part the machine treated as an afterthought: if returns swing by major and institution, then which college and which major make the entire decision, not whether. Yet the “highly lucrative alternatives”—trades, bootcamps, the military—get waved through with no numbers at all, carrying the very selection and survivorship problems the answer just flagged for college.
Two more issues. If the payoff “depends on personal career goals,” then there is no general answer, which contradicts the confident “Yes.” And if majors and institutions are the real drivers, the headline advice to save on gen eds at a community college aims at the wrong variable. The prescription doesn’t follow from its own diagnosis.
C — What’s the context?
Who wrote this? A model trained on the open internet, where the college-ROI genre is owned by universities marketing themselves, lenders marketing loans, and listicles recycling both. The machine filled the gaps with Reddit, Quora, and Medium posts, which is exactly what this answer leans on. The machine has no stake in your kid’s future. Its sources did.
Now count the citations: 1, 2, 3, then 4 and 6, then 8 through 11, then 13 through 17. Five, seven, and twelve never appear. A sourcing apparatus that can’t keep count of its own sources is a tell, all by itself.
Watch the words drift inside a single section, too. The alternatives are “highly lucrative” in one sentence and pay “excellent livable wages” in the next—lucrative downgraded to livable while you weren’t looking. Fluency is what the machine optimizes. Sleight-of-hand is what we got.
What just happened
We asked five questions in ten minutes. A reasonable-sounding answer turned out to hold a swapped claim, evidence that’s real but dated and missing the key trend we’re worried about, reasoning built on selection bias and extrapolation, a conclusion resting on more assumptions than it admits, and a source list pockmarked with self-interested promotion and anonymous forums.
And the machine’s answer wasn’t bad. As a place to start—to pull those statistics and read deeper into current trends—it’s useful. The danger was never the answer. It was a reader relying on it whole.
Here’s the claim, stated plainly. AI generates text; only a reader generates judgment. The machine even named critical thinking—once, as a consolation prize for arts and humanities majors. It had its own product backward. The more fluent text we’re handed, the more of that reasoned judgment we have to bring ourselves.
Try it this week. Ask any AI a question you actually care about, run the five CERIC questions on its answer, then reply or comment and tell me what you caught. Next walkthrough, we’ll point CERIC at something harder—maybe you’d like to suggest an article in the comments.
Read deeply,
Dr. Genevive