AI Data Study: 87% of CNET’s AI Content Is Detectable By A Public Tool

We wanted to find out if AI generated content can replace real journalists & writers.

(TLDR: AI can’t replace real writers, we have the data to prove it!)

Popular media publications like CNET are starting to use AI to help write their content in an effort to reduce costs and increase publishing frequency.

BUT:

Google have already stated they will label AI generated content as spam which can lower search traffic for any site caught using it.

So we decided to run CNET’s AI generated content through a public AI detection tool.

This is what we found:

  • 87.2% of CNET’s AI generated content was detectable with a public tool
  • 19.2% of the AI generated content on CNET used more than 50% AI
  • 7.7% of CNET’s AI generated content used more than 75% of AI content
  • 12.8% of the AI generated content on CNET had zero detectable AI content

cnet case study infographic

The fact that it is so easy to detect content generated by AI means there is always the risk of being labelled a spammer by Google or other entities.

Ultimately this means that using AI generated content comes with a huge risk to a websites traffic, email deliverability and revenue alongside the other inherent risks of using AI content such as its accuracy.

87.2% of CNET’s AI content was detectable

In total, 68 of the 78 articles generated by CNET’s AI were detectable by a public tool in our testing:

87.2% of CNET's AI content was detectable

12.8% of CNET’s AI content was not detectable

We could not detect any AI content in 10 of the 78 articles that we tested from CNET’s AI content production process:

12.8% of CNET's AI content had zero detectable AI content

19.2% of CNET’s AI content featured 50%+ of AI writing

15 out of the 78 articles that we tested had at least 50% of their total content written by CNET’s AI engine:

19.2% of CNET's AI content featured 50%+ of AI writing

7.7% of CNET’s AI content featured 75%+ of AI writing

Our testing found that 6 of the 78 articles had at least 75% of their total content written by CNET’s AI engine:

7.7% of CNET's AI content used at least 75% of AI writing

Additional Resources

Take a look at the stories below to learn more about how CNET is openly using AI content:

  1. CNET Is Quietly Publishing Entire Articles Generated By AI
  2. OFFICIAL RESPONSE: CNET Is Experimenting With an AI Assist. Here’s Why
  3. CNET pauses publishing AI-written stories after disclosure controversy

The Testing Process

To conduct this test, we followed a simple process:

  1. Download all of the AI content published by CNET (78 articles total)
  2. We ran each article through the Originality AI content detection tool
  3. Then recorded the result along with a screenshot

case study data

Test Data

You can find A Google sheet with the results here: https://docs.google.com/spreadsheets/d/1Yur7kKP5BMWA0eaPBDnJmJ_l9TtWQusNH88khTXkw8A/view

Alternatively, you can refer to the table below:

IDURLResult
1https://www.cnet.com/personal-finance/credit-cards/can-you-buy-a-gift-card-with-a-credit-card/25% AI
2https://www.cnet.com/personal-finance/banking/what-is-annual-percentage-yield/52% AI
3https://www.cnet.com/personal-finance/banking/what-is-overdraft-protection-and-do-you-need-it/1% AI
4https://www.cnet.com/personal-finance/banking/what-is-compound-interest/0% AI
5https://www.cnet.com/personal-finance/credit-cards/how-to-treat-a-credit-card-like-a-debit-card/1% AI
6https://www.cnet.com/personal-finance/banking/should-you-break-a-cd-early-for-a-better-rate/2% AI
7https://www.cnet.com/personal-finance/banking/overdraft-fees-vs-nonsufficient-funds-fees-whats-the-difference/7% AI
8https://www.cnet.com/personal-finance/banking/what-are-nsf-fees-and-why-do-banks-charge-them/3% AI
9https://www.cnet.com/personal-finance/banking/what-is-zelle-and-how-does-it-work/91% AI
10https://www.cnet.com/personal-finance/credit-cards/does-it-hurt-to-pay-off-your-credit-card-balance-before-your-billing-cycle-ends/29% AI
11https://www.cnet.com/personal-finance/credit-cards/how-to-set-up-autopay-for-your-credit-cards/50% AI
12https://www.cnet.com/personal-finance/credit-cards/how-being-an-authorized-user-affects-your-credit-score/0% AI
13https://www.cnet.com/personal-finance/banking/alternatives-to-traditional-savings-accounts/49% AI
14https://www.cnet.com/personal-finance/banking/what-happens-when-you-bounce-a-check/1% AI
15https://www.cnet.com/personal-finance/banking/how-to-cash-a-check-without-a-bank-account/19% AI
16https://www.cnet.com/personal-finance/banking/how-to-get-your-overdraft-fees-refunded/17% AI
17https://www.cnet.com/personal-finance/credit-cards/does-experian-boost-improve-your-credit-score/0% AI
18https://www.cnet.com/personal-finance/credit-cards/important-dates-to-know-for-your-credit-cards/2% AI
19https://www.cnet.com/personal-finance/credit-cards/how-to-request-a-downgrade-for-a-credit-card/1% AI
20https://www.cnet.com/personal-finance/credit-cards/major-credit-reporting-agencies/50% AI
21https://www.cnet.com/personal-finance/credit-cards/fico-score-vs-credit-score/0% AI
22https://www.cnet.com/personal-finance/credit-cards/what-is-a-vantagescore/1% AI
23https://www.cnet.com/personal-finance/banking/what-is-a-money-market-account/0% AI
24https://www.cnet.com/personal-finance/mortgages/how-to-cancel-home-equity-loan/0% AI
25https://www.cnet.com/personal-finance/mortgages/does-home-equity-loan-affect-pmi/43% AI
26https://www.cnet.com/personal-finance/credit-cards/what-is-a-fico-score/28% AI
27https://www.cnet.com/personal-finance/credit-cards/what-factors-determine-your-credit-score/1% AI
28https://www.cnet.com/personal-finance/credit-cards/calculate-income-for-credit-application/3% AI
29https://www.cnet.com/personal-finance/banking/community-development-financial-institutions/97% AI
30https://www.cnet.com/personal-finance/banking/no-penalty-cd-vs-savings-account/9% AI
31https://www.cnet.com/personal-finance/banking/difference-between-bank-and-credit-union/43% AI
32https://www.cnet.com/personal-finance/banking/atm-withdrawal-limits/86% AI
33https://www.cnet.com/personal-finance/banking/second-chance-checking-account/5% AI
34https://www.cnet.com/personal-finance/credit-cards/how-minimum-payments-are-decided/3% AI
35https://www.cnet.com/personal-finance/credit-cards/how-to-get-credit-increase/1% AI
36https://www.cnet.com/personal-finance/banking/how-to-choose-online-bank/5% AI
37https://www.cnet.com/personal-finance/banking/what-is-emergency-fund/25% AI
38https://www.cnet.com/personal-finance/banking/how-to-open-a-savings-account/1% AI
39https://www.cnet.com/personal-finance/banking/how-to-close-bank-account/34% AI
40https://www.cnet.com/personal-finance/credit-cards/how-to-get-a-debit-card/17% AI
41https://www.cnet.com/personal-finance/banking/open-money-market-account/96% AI
42https://www.cnet.com/personal-finance/banking/how-to-build-cd-ladder/21% AI
43https://www.cnet.com/personal-finance/banking/are-cds-worth-it/40% AI
44https://www.cnet.com/personal-finance/credit-cards/charge-card-vs-credit-card/9% AI
45https://www.cnet.com/personal-finance/banking/how-much-should-you-keep-in-a-cd/0% AI
46https://www.cnet.com/personal-finance/credit-cards/chase-preapproved-cards/3% AI
47https://www.cnet.com/personal-finance/credit-cards/what-is-credit-card/52% AI
48https://www.cnet.com/personal-finance/credit-cards/how-old-to-get-a-credit-card/0% AI
49https://www.cnet.com/personal-finance/credit-cards/credit-card-basics/4% AI
50https://www.cnet.com/personal-finance/credit-cards/minimum-age-authorized-user/1% AI
51https://www.cnet.com/personal-finance/credit-cards/pros-cons-of-credit-cards/15% AI
52https://www.cnet.com/personal-finance/credit-cards/tax-deductible-credit-card-interest/0% AI
53https://www.cnet.com/personal-finance/banking/how-to-open-certificate-of-deposit/42% AI
54https://www.cnet.com/personal-finance/banking/what-is-certificate-of-deposit/1% AI
55https://www.cnet.com/personal-finance/credit-cards/line-of-credit-vs-credit-card/13% AI
56https://www.cnet.com/personal-finance/banking/what-is-high-yield-savings-account/8% AI
57https://www.cnet.com/personal-finance/credit-cards/card-expiration-dates-explained/37% AI
58https://www.cnet.com/personal-finance/credit-cards/do-you-need-a-credit-card/2% AI
59https://www.cnet.com/personal-finance/credit-cards/soft-pull-vs-hard-pull-credit-inquiry/0% AI
60https://www.cnet.com/personal-finance/banking/whats-the-difference-between-a-cashiers-check-and-a-money-order/5% AI
61https://www.cnet.com/personal-finance/credit-cards/credit-card-cancelled-after-being-approved/50% AI
62https://www.cnet.com/personal-finance/banking/are-certificates-of-deposit-safe/2% AI
63https://www.cnet.com/personal-finance/credit-cards/statement-balance-vs-current-balance/22% AI
64https://www.cnet.com/personal-finance/credit-cards/how-long-to-get-credit-card/92% AI
65https://www.cnet.com/personal-finance/credit-cards/how-long-to-wait-between-credit-card-applications/29% AI
66https://www.cnet.com/personal-finance/credit-cards/credit-card-0-apr-period-ends/8% AI
67https://www.cnet.com/personal-finance/credit-cards/maximize-credit-card-cash-back/52% AI
68https://www.cnet.com/personal-finance/banking/pros-and-cons-of-investing-in-cds/1% AI
69https://www.cnet.com/personal-finance/credit-cards/what-is-a-credit-card-number/52% AI
70https://www.cnet.com/personal-finance/credit-cards/are-you-prequalified-for-a-credit-card/49% AI
71https://www.cnet.com/personal-finance/credit-cards/does-applying-for-card-hurt-credit/47% AI
72https://www.cnet.com/personal-finance/banking/types-of-certificates-of-deposit/13% AI
73https://www.cnet.com/personal-finance/banking/what-is-a-cd-ladder/49% AI
74https://www.cnet.com/personal-finance/banking/are-online-banks-safe/51% AI
75https://www.cnet.com/personal-finance/credit-cards/credit-card-chargeback/80% AI
76https://www.cnet.com/personal-finance/credit-cards/credit-card-fees-and-penalties-faqs/56% AI
77https://www.cnet.com/personal-finance/credit-cards/co-branded-cards-explained/7% AI
78https://www.cnet.com/personal-finance/credit-cards/what-is-a-credit-card-charge-off/47% AI