--- title: Why Creativity Benchmarks Like TTCT, TTCW, and CAT Fail LLM Copywriting description: TTCT, TTCW, and CAT benchmarks fail at measuring real AI creativity. Discover why these tests aren’t fit for modern LLMs, and what marketers should measure instead. image: https://jam7.com/hubfs/Imported_Blog_Media/jam7-alignment-ruler-macro.webp --- [Skip to main menu](https://jam7.com/blog/why-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting#main-menu) [Skip to footer](https://jam7.com/blog/why-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting#footer-menu) [![jam-7-logo-rgb](https://jam7.com/hubfs/agency-web/branding/logo/jam-7-logo-rgb.svg)](https://jam7.com/) - [Product](https://jam7.com/agentic-marketing-platform) - [Agents](https://jam7.com/agents) - [Case Studies](https://jam7.com/case-studies) - Company - Learn [Login](https://app.jam7.com/) [Book a Demo](https://jam7.com/book-a-demo) Try AMP AMP - [Agentic Marketing Platform®](https://jam7.com/agentic-marketing-platform) - [Agents](https://jam7.com/agents) - [Content](https://jam7.com/marketing-content) - [Onboarding](https://jam7.com/onboarding) Validate - [Security & Compliance](https://jam7.com/security-and-compliance) - [Compare AMP](https://jam7.com/compare-amp) ### [AMP V1 - Building an Agentic User Experience](https://jam7.com/news-and-announcements/amp-v1-building-an-agentic-user-experience) - [About](https://jam7.com/about) - [Careers](https://jam7.com/careers) - [Press / News](https://jam7.com/news-and-announcements) - [Contact](https://jam7.com/contact) - [Blog](https://jam7.com/blog) - [Resources](https://jam7.com/resources) - [B2B Glossary](https://jam7.com/glossary) [![jam-7-logo-rgb](https://jam7.com/hubfs/agency-web/branding/logo/jam-7-logo-rgb.svg)](https://jam7.com/) - [Product](https://jam7.com/agentic-marketing-platform) - AMP - [Agentic Marketing Platform®](https://jam7.com/agentic-marketing-platform) - [Agents](https://jam7.com/agents) - [Content](https://jam7.com/marketing-content) - [Onboarding](https://jam7.com/onboarding) - Validate - [Security & Compliance](https://jam7.com/security-and-compliance) - [Compare AMP](https://jam7.com/compare-amp) - [Agents](https://jam7.com/agents) - [Case Studies](https://jam7.com/case-studies) - Company - [About](https://jam7.com/about) - [Careers](https://jam7.com/careers) - [Press / News](https://jam7.com/news-and-announcements) - [Contact](https://jam7.com/contact) - Learn - [Blog](https://jam7.com/blog) - [Resources](https://jam7.com/resources) - [B2B Glossary](https://jam7.com/glossary) [Login](https://app.jam7.com/) [Book a Demo](https://jam7.com/book-a-demo) Try AMP ## Try AMP **for free** Free 14-day trial. No credit card required. Cancel any time. Already using AMP? [**Sign in with an existing account**](https://app.jam7.com/) 1. [Home](https://jam7.com/) 2. • 3. [Blog](https://jam7.com/blog/) 4. • 5. Why Creativity Benchmarks Like… # Why Creativity Benchmarks Like TTCT, TTCW, and CAT Fail LLM Copywriting ![Netanel Eliav’s avatar](https://jam7.com/hs-fs/hubfs/website/resources/avatar/netanel-eliav-avatar.webp?width=62&height=62&name=netanel-eliav-avatar.webp) Written by Netanel Eliav CTO - [AI Marketing Strategy](https://jam7.com/blog/tag/ai-marketing-strategy) - [Creativity & Storytelling](https://jam7.com/blog/tag/creativity-storytelling) | April 7, 2025 Summarise with AI: - [![social icon](https://jam7.com/hubfs/agency-web/graphics/vectors/socials/chatgpt-icon.svg)](https://chat.openai.com/?q=Summarize+this+article+in+a+clear+and+concise+way+for+a+performance-driven+B2B+marketer+who+cares+about+pipeline%2C+ICP+fit%2C+and+efficient+spend+%28not+vanity+metrics%29.%0A++++++++++++++Name+of+the+article%3A+Why+Creativity+Benchmarks+Like+TTCT%2C+TTCW%2C+and+CAT+Fail+LLM+Copywriting.%0A++++++++++++++Article+URL%3A+https%3A%2F%2Fjam7.com%2Fblog%2Fwhy-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting.%0A++++++++++++++Please+provide%3A%0A++++++++++++++1%29+Brief+overview+of+the+main+topic%0A++++++++++++++++-+1+short+paragraph+explaining+what+the+article+is+about+and+why+it+matters+for+B2B+marketers+focused+on+pipeline+quality%2C+ICP+fit%2C+and+efficient+spend.%0A++++++++++++++2%29+Key+insights+and+takeaways%0A++++++++++++++++-+3%E2%80%936+bullets+focused+on+practical%2C+performance-oriented+insights+from+the+article%0A++++++++++++++3%29+Important+conclusions+or+recommendations%0A++++++++++++++++-+1%E2%80%932+short+paragraphs+with+clear%2C+actionable+recommendations+or+next+steps.%0A++++++++++++++From+the+internal+links+in+the+article+content%2C+pick+2%E2%80%933+of+the+most+relevant+links+that+a+B2B+marketer+should+read+next.%0A++++++++++++++Selection+rules%3A%0A++++++++++++++-+Only+choose+links+that+are+on+the+same+domain+as+the+article.%0A++++++++++++++-+Do+NOT+invent+URLs+or+titles%3B+only+use+links+you+actually+find+on+the+page.%0A++++++++++++++Output+format%3A%0A++++++++++++++-+Add+a+final+section+titled%3A+%E2%80%98Recommended+next+reads+from+this+site%E2%80%99.%0A++++++++++++++-+Under+this+heading%2C+list+2%E2%80%933+items+with+title%2C+why+it%E2%80%99s+useful%2C+and+the+exact+URL.&utm_source=ai-share&utm_medium=blog&utm_campaign=Blog) - [![social icon](https://jam7.com/hubfs/agency-web/graphics/vectors/socials/perplexity-logo.svg)](https://www.perplexity.ai/search/new?q=Summarize+this+article+in+a+clear+and+concise+way+for+a+performance-driven+B2B+marketer+who+cares+about+pipeline%2C+ICP+fit%2C+and+efficient+spend+%28not+vanity+metrics%29.%0A++++++++++++++Name+of+the+article%3A+Why+Creativity+Benchmarks+Like+TTCT%2C+TTCW%2C+and+CAT+Fail+LLM+Copywriting.%0A++++++++++++++Article+URL%3A+https%3A%2F%2Fjam7.com%2Fblog%2Fwhy-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting.%0A++++++++++++++Please+provide%3A%0A++++++++++++++1%29+Brief+overview+of+the+main+topic%0A++++++++++++++++-+1+short+paragraph+explaining+what+the+article+is+about+and+why+it+matters+for+B2B+marketers+focused+on+pipeline+quality%2C+ICP+fit%2C+and+efficient+spend.%0A++++++++++++++2%29+Key+insights+and+takeaways%0A++++++++++++++++-+3%E2%80%936+bullets+focused+on+practical%2C+performance-oriented+insights+from+the+article%0A++++++++++++++3%29+Important+conclusions+or+recommendations%0A++++++++++++++++-+1%E2%80%932+short+paragraphs+with+clear%2C+actionable+recommendations+or+next+steps.%0A++++++++++++++From+the+internal+links+in+the+article+content%2C+pick+2%E2%80%933+of+the+most+relevant+links+that+a+B2B+marketer+should+read+next.%0A++++++++++++++Selection+rules%3A%0A++++++++++++++-+Only+choose+links+that+are+on+the+same+domain+as+the+article.%0A++++++++++++++-+Do+NOT+invent+URLs+or+titles%3B+only+use+links+you+actually+find+on+the+page.%0A++++++++++++++Output+format%3A%0A++++++++++++++-+Add+a+final+section+titled%3A+%E2%80%98Recommended+next+reads+from+this+site%E2%80%99.%0A++++++++++++++-+Under+this+heading%2C+list+2%E2%80%933+items+with+title%2C+why+it%E2%80%99s+useful%2C+and+the+exact+URL.&utm_source=ai-share&utm_medium=blog&utm_campaign=Blog) - [![social icon](https://jam7.com/hubfs/agency-web/graphics/vectors/socials/claude-logo.svg)](https://claude.ai/new?q=Summarize+this+article+in+a+clear+and+concise+way+for+a+performance-driven+B2B+marketer+who+cares+about+pipeline%2C+ICP+fit%2C+and+efficient+spend+%28not+vanity+metrics%29.%0A++++++++++++++Name+of+the+article%3A+Why+Creativity+Benchmarks+Like+TTCT%2C+TTCW%2C+and+CAT+Fail+LLM+Copywriting.%0A++++++++++++++Article+URL%3A+https%3A%2F%2Fjam7.com%2Fblog%2Fwhy-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting.%0A++++++++++++++Please+provide%3A%0A++++++++++++++1%29+Brief+overview+of+the+main+topic%0A++++++++++++++++-+1+short+paragraph+explaining+what+the+article+is+about+and+why+it+matters+for+B2B+marketers+focused+on+pipeline+quality%2C+ICP+fit%2C+and+efficient+spend.%0A++++++++++++++2%29+Key+insights+and+takeaways%0A++++++++++++++++-+3%E2%80%936+bullets+focused+on+practical%2C+performance-oriented+insights+from+the+article%0A++++++++++++++3%29+Important+conclusions+or+recommendations%0A++++++++++++++++-+1%E2%80%932+short+paragraphs+with+clear%2C+actionable+recommendations+or+next+steps.%0A++++++++++++++From+the+internal+links+in+the+article+content%2C+pick+2%E2%80%933+of+the+most+relevant+links+that+a+B2B+marketer+should+read+next.%0A++++++++++++++Selection+rules%3A%0A++++++++++++++-+Only+choose+links+that+are+on+the+same+domain+as+the+article.%0A++++++++++++++-+Do+NOT+invent+URLs+or+titles%3B+only+use+links+you+actually+find+on+the+page.%0A++++++++++++++Output+format%3A%0A++++++++++++++-+Add+a+final+section+titled%3A+%E2%80%98Recommended+next+reads+from+this+site%E2%80%99.%0A++++++++++++++-+Under+this+heading%2C+list+2%E2%80%933+items+with+title%2C+why+it%E2%80%99s+useful%2C+and+the+exact+URL.&utm_source=ai-share&utm_medium=blog&utm_campaign=Blog) - ![social icon](https://jam7.com/hubfs/agency-web/graphics/vectors/socials/gemini-logo.svg) ![](https://jam7.com/hs-fs/hubfs/Imported_Blog_Media/jam7-alignment-ruler-macro.webp?width=1024&height=1024&name=jam7-alignment-ruler-macro.webp) In this Blog Creativity isn’t a score you tick on a form or a label you glue to AI output. Yet, the industry is obsessed with benchmarks - TTCT (Torrance Tests of Creative Thinking), TTCW (Torrance Test of Creative Writing), and CAT (Creative Assessment Test). Are these the gold standard for measuring LLM and AI creativity? Hardly. Here’s why you need to question everything you hear about “creative benchmarks”. ## Introduction Let’s be honest. Measuring creativity with the TTCT, TTCW, or by executing the CAT is like testing a jazz musician with scales - technically sound, playful in theory, but missing the wildness that makes real artistry. Add large language models (LLMs) to the mix, and all the nice, neat assumptions go out the window. This post tears apart the limits of these benchmarks. Expect brutal honesty, sharp analogies, and a roadmap for those who want something better for Product Marketing, Growth Hacking, and B2B Content Marketing. You’ll get answers, not platitudes. ## What are the TTCT, TTCW, and CAT? - **TTCT:** Measures divergent thinking - fluency, flexibility, originality, elaboration. Has long “ranked” human kids for school gifted-and-talented programs. - **TTCW:** Adaptation of TTCT for creative writing. Assesses how original or expressive your story is, or if you just rewrote Harry Potter with dragons in space. - **CAT:** A panel of experts say, “Is this creative or not?” - subjective but closer to how we really experience new ideas. In an era dominated by marketing automation and conversational AI, these tools have become fashionable benchmarks for judging LLM performance. ## The Big Lie About Benchmarking AI Creativity A hard truth: LLMs nail the structure of these tests - sometimes outscoring humans. But it’s an illusion. A high TTCT or TTCW score says nothing about whether AI can actually invent, surprise, or move us. Here’s why: - **Training vs. Creativity:** LLMs regurgitate patterns. The more you train them on benchmark datasets, the more they game the test. It’s no different from a band memorising one setlist. Play them something new and they freeze. - **“Expert” Subjectivity:** CAT relies on human panels. Humans bring bias - favouring familiar forms or styles, especially if they know it’s AI. What’s “creative” becomes what’s “expected”. - **Success is a Mirage:** Some studies trumpet “AI exams-top-1%-originality!” Nonsense. Those same models fail, three to ten times more often, when the TTCW is applied outside its favourite dataset. ## TTCT and TTCW: Built for Humans, Skewed for AIs - **Cultural and Contextual Blindness:** AI doesn’t “get” the context behind answers the way a person does. TTCT rewards left-field association - culturally loaded. LLMs don’t natively understand this. They imitate linguistically, but miss the music behind the words. - **Static and Stale:** Longitudinal data on TTCT shows scores don’t really climb with age or training. You can “improve” by teaching people to hack the test, but that’s just test-savvy, not genuine creative leaps. ## CAT: Creative by Committee - **Subjectivity Overload:** Ask three experts if a story is creative, get five answers. CAT gives the illusion of rigour, but two problems linger: - Panel fatigue - human raters get bored, lazy, or over-influenced by previous answers. - Overfitting - LLMs tuned to “sound creative” for these panels, but utterly predictable in real product marketing or campaign work. - **No Process Transparency:** You can’t audit a CAT-like you can a codebase. The subjectivity is the “feature” - and also the fatal weakness. ## LLM Creativity Benchmarks: Currently a Racket Recent industry attempts to benchmark copywriting, storytelling, or ideation in LLMs have become competitions for who can tune their model for test conditions. Example: “GPT-4 outperforms humans on originality” - except it fails to sustain surprise when the format changes, stakes are real, or when marketers actually need fresh product roadmaps. ### Problems in Practice: - **Gaming the Metrics:** LLMs are optimised for the metric, not for innovation. This is growth hacking without the growth. - **Repetition Disguised as Creativity:** AI can remix words, spin up clever analogies, or spoof tone - see this [Jam 7 review of AI’s typographical "sins"](https://jam7.com/blog/the-typographical-sins-of-ai-why-machines-love-em-dashes) - but that’s hardly invention. - **Sterility at Scale:** The more you “perfect” the benchmark, the more you sap the irregularity needed for genuine creative leaps. [Human imperfection is the secret sauce for AI creativity](https://jam7.com/blog/human-imperfection-holds-the-key-to-ai-creativity). ## Why It Matters for Product Marketing and B2B Growth Fake benchmarks deliver fake confidence - a trap for anyone pushing product marketing or content at scale. - Brands using AI for market differentiation can’t rely on hollow scores; you need storytelling that resonates, not that “ticks boxes”. - Agencies boasting about LLM benchmarks? Demand to see actual results - case studies, unique campaign ideas, unexpected angles. - [AI-generated content should fuel creativity, not flatten it](https://jam7.com/blog/ai-generated-content-revolutionising-storytelling-and-reshaping-human-creativity). ## What Marketers and Growth Teams Should Do Instead Not all is lost. Ditching tired benchmarks opens doors for new approaches - and braver outcomes: ## Steps for Real Creative Evaluation 1. **Diversity in Testing:** Rotate prompts and domains, avoid “seen before” patterns. Force LLMs outside comfort zones. 2. **Human-AI Teamwork:** Pair AI with human creatives, and measure the impact on campaign freshness, conversion rates, and customer feedback. 3. **Qualitative Reviews:** Use audience reactions, peer scoring, and real KPIs. If the idea flops in the wild, creative or not, it doesn’t matter. 4. **Continuous Iteration:** Test, remix, and break the rules. Encourage surprise, not conformity. ## Final Word: Challenge Every Creative Metric If you’re in product marketing, growth hacking, or steering an agency’s product roadmap - don’t settle for the “best” AI on TTCT or similar. Hold vendors and internal AI teams accountable for impact, not just test scores. Creativity is a punk band, not a symphony orchestra. Safe is boring. If your AI makes you safe, you’re playing the wrong game.   This blog post created using AMP! ## Your competitors are answering. Are you? Get your prioritised growth audit in 5 minutes. See exactly where you're losing trust, and how to win it back with Speed, Scale, Consistency, and Credibility. [Get your AI Growth Audit](https://cta-eu1.hubspot.com/web-interactives/public/v1/track/click?encryptedPayload=AVxigLLNm1nzRJhLhL1%2BCr65S0dYhk%2Bup7Ju6ep5tq0m3rYReo2LmHAIJyvWGLcpcQMT7Kec6Y9GjU7julKkMzzkqBsi2ZfDaZtNh22%2FBcIJF0Lvk8dwpcCbOtdSEdZrppT1mrVc2TqRf6GjoBMuArGuKUVlTYQk5zkg%2B%2F%2BqDV0MoZPrf8LiyFhA&portalId=143516351) ## Related posts (You might also like) ### [![AI Marketing Automation: Trust What Ships](https://143516351.fs1.hubspotusercontent-eu1.net/hubfs/143516351/Blog%2013%20-%20AI%20Marketing%20Automation-%20Trust%20What%20Ships.webp) - AI Marketing Strategy AI Marketing Automation: Trust What Ships](https://jam7.com/blog/ai-marketing-automation-scale-output-without-losing-control) ### [![AI Compliance Framework for Governance Workflows](https://143516351.fs1.hubspotusercontent-eu1.net/hubfs/143516351/Blog%2012%20-%20AI%20Compliance%20Framework%20for%20Governance%20Workflows.webp) - AI Marketing Strategy - Agentic AI AI Compliance Framework for Governance Workflows](https://jam7.com/blog/ai-compliance-framework) ### [![The Marketing QA Checklist That Stops AI Content From Drifting Off-Strategy](https://143516351.fs1.hubspotusercontent-eu1.net/hubfs/143516351/Blog%2010%20-%20The%20Marketing%20QA%20Checklist%20That%20Stops%20AI%20Content%20From%20Drifting%20Off-Strategy.webp) - AI Marketing Strategy The Marketing QA Checklist That Stops AI Content From Drifting Off-Strategy](https://jam7.com/blog/marketing-qa-checklist-ai-content-drift) ## Marketing 24x7 Direction in. Delivery out. Your team always in control. [![jam-7-logo-primary](https://jam7.com/hubfs/agency-web/branding/logo/jam-7-logo-primary.svg)](https://jam7.com/) Your AI marketing team. A shared Marketing Brain powers agents that plan, create and ship, 24/7 — with you always in control. - Get started - [Login](https://app.jam7.com/) - [AMP®](https://jam7.com/agentic-marketing-platform) - [Book a Demo](https://jam7.com/book-a-demo) - [Case Studies](https://jam7.com/case-studies) - Services - [Growth Strategy](https://jam7.com/growth-strategy) - [Positioning & Messaging](https://jam7.com/positioning-and-messaging) - [Organic & AI Search](https://jam7.com/organic-ai-search) - [Paid Media](https://jam7.com/paid-media) - [Website Design & Build](https://jam7.com/web-design-and-build) - [Conversion Rate Optimisation](https://jam7.com/cro) - Company - [About](https://jam7.com/about) - [Careers](https://jam7.com/careers) - [News / Announcements](https://jam7.com/news-and-announcements) - [Why Jam 7](https://jam7.com/compare-amp) - Insights - [Blog](https://jam7.com/blog) - [B2B Glossary](https://jam7.com/glossary) - [Resources](https://jam7.com/resources) © Jam 7 Ltd 2026. All rights reserved. - [Privacy Policy](https://jam7.com/privacy-policy) - [Terms of Use](https://jam7.com/terms-of-use) - [Cookie Policy](https://jam7.com/cookie-policy) - [Modern Slavery Policy](https://jam7.com/modern-slavery-policy) ```json { "@context" : "https://schema.org", "@id" : "https://jam7.com/#organization", "@type" : "Organization", "address" : { "@type" : "PostalAddress", "addressCountry" : "UK", "addressLocality" : "London", "addressRegion" : "England", "postalCode" : "W1W 6XH" }, "logo" : { "@type" : "ImageObject", "url" : "https://143516351.fs1.hubspotusercontent-eu1.net/hubfs/143516351/Jam%207%20Brand%20Assets/Logos/SVG/Logo_Positive_1.svg" }, "name" : "Jam 7 Ltd", "url" : "https://jam7.com" } ``` ```json { "@context" : "https://schema.org", "@type" : "Article", "author" : [ { "@type" : "Person", "name" : "Netanel Eliav", "url" : "https://jam7.com/blog/author/netanel-eliav" } ], "dateModified" : "2026-04-07T18:41:38+0000", "datePublished" : "2025-04-07T18:33:23+0000", "description" : "TTCT, TTCW, and CAT benchmarks fail at measuring real AI creativity. Discover why these tests aren’t fit for modern LLMs, and what marketers should measure instead.", "headline" : "Why Creativity Benchmarks Like TTCT, TTCW, and CAT Fail LLM Copywriting", "image" : [ "https://143516351.fs1.hubspotusercontent-eu1.net/hubfs/143516351/Imported_Blog_Media/jam7-alignment-ruler-macro.webp" ], "inLanguage" : "en", "mainEntityOfPage" : { "@id" : "https://jam7.com/blog/why-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting" }, "publisher" : { "@type" : "Organization", "name" : "Jam 7 Ltd", "url" : "https://jam7.com/blog/why-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting" } } ``` ```json { "@context" : "https://schema.org", "@type" : "LocalBusiness", "address" : { "@type" : "PostalAddress", "addressCountry" : "UK", "addressLocality" : "London", "addressRegion" : "England", "postalCode" : "W1W 6XH" }, "name" : "Jam 7 Ltd", "url" : "https://jam7.com/blog/why-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting" } ``` ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Netanel Eliav", "url" : "https://jam7.com/blog/author/netanel-eliav" }, "dateModified" : "2026-04-07T18:41:38.792Z", "datePublished" : "2025-04-07T18:33:23.000Z", "headline" : "Why Creativity Benchmarks Like TTCT, TTCW, and CAT Fail LLM Copywriting", "image" : [ "https://jam7.com/hubfs/Imported_Blog_Media/jam7-alignment-ruler-macro.webp" ], "mainEntityOfPage" : { "@id" : "https://jam7.com/blog/why-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://jam7.com/hubfs/Jam%207%20Brand%20Assets/Logos/SVG/Logo_Positive_1.svg" }, "name" : "Jam 7 Ltd" } } ``` ```json { "@context" : "https://schema.org", "@type" : "BreadcrumbList", "itemListElement" : [ { "@type" : "ListItem", "item" : "1/", "name" : "Home", "position" : 1 }, { "@type" : "ListItem", "item" : "1/blog/", "name" : "Blog", "position" : 2 }, { "@type" : "ListItem", "item" : "1/blog/why-creativity-benchmarks-like-ttct-ttcw-and-cat-fail-llm-copywriting/", "name" : "Why Creativity Benchmarks Like TTCT, TTCW, and CAT Fail LLM Copywriting