Owned by Signal8 Inc., maker of Octo and Signal8 Pro. Not investment advice. About this site
stockairesearch / lab

Claude vs ChatGPT for stock research

By , Signal8 Research. Published by Signal8 Inc.

Blind rounds 2026-11-10 and 2026-11-11 · Claude #2, ChatGPT #3 in both · Octo first on the tie-break · plans checked Nov 9, 2026

In our blind test of 40 SEC filing questions, Claude scored 160 of 160 and ranked #2 of 6; ChatGPT scored 159 and ranked #3. Signal8's Octo, which also scored 160, ranked first on our published tie-break. Both answered every question and neither gave a wrong figure; ChatGPT's one lost mark was a source the grader could not open on R2-40. One mark on 40 questions is too small a gap to call a winner, and the setups differed: Claude ran as Opus 5.5 with web search, ChatGPT on its free plan.

The harder round 3, on 2026-11-11, did not name the filing, and there the gap opened: Claude 156 of 160 with no wrong figure, ChatGPT 145 with 2. Over both rounds Claude has 316 of 320 and ChatGPT 304. For the three-way view with Signal8's Octo, see Claude vs ChatGPT vs Signal8 Octo.

Claude is ahead on research jobs too. In our capability round on November 12, 2026, 20 tasks such as backtests, market screens and event studies, Claude scored 34 of 40 (#1 of five) and ChatGPT's free plan 26 (#3); Signal8's Octo was second with 28. Claude's score was corrected on November 13, 2026: its first run scored 16 because of a harness fault on our side, and 9 tasks were re-run (correction).

Round 3 head to head (filing not named)

Blind round 3, 2026-11-11: answers out of 40 on each mark
MarkClaudeChatGPT
Figure correct4038
Cites a source4035
Source contains it3634
As-of date right4038
Total score156 / 160145 / 160
Wrong figures02
Linked the original SEC filing, round 334 of 4019 of 40

ChatGPT's round 3 misses: R3-10, R3-12, R3-27, R3-32, R3-35, R3-36, R3-40. Claude's: R3-12, R3-16, R3-27, R3-30, each a source mark, with every figure right.

Where the answers came from

Claude linked the original SEC filing on 63 of 80 answers and other websites on 59; ChatGPT linked the filing on 50 and other websites on 12, and on 24 answers no link was captured at all. Octo cited the SEC filing itself on 77 of 80 answers and never relied on a third-party site.

Where the answer came from, blind rounds 2 and 3 (November 10 and 11, 2026). Counted from the links captured from each tool's page on every graded answer. "Original SEC filing" is a link to the filing on sec.gov's EDGAR archive or to Signal8's filing viewer, which opens the filing by its accession number. "Other website" is any other site: news, data aggregators such as Stock Titan, and company web pages. A filing named only in text, with no link, counts as neither.
ToolAnswers countedLinked the original SEC filingLinked another websiteOther websites onlyRound 2 / round 3: SEC filing linked
Signal8 Octo
Made by Signal8, which runs this lab
8077 of 800 of 800 of 8038 of 40 / 39 of 40
Claude8063 of 8059 of 8017 of 8029 of 40 / 34 of 40
ChatGPT8050 of 8012 of 806 of 8031 of 40 / 19 of 40
AskEdgar Studio8026 of 801 of 800 of 8016 of 40 / 10 of 40
Perplexity7951 of 7927 of 7916 of 7924 of 40 / 27 of 39
GeminiNot measuredNot measuredNot measuredNot measuredNot measured

Gemini is not measured: its links could not be captured from its page, so we report no figure rather than a zero. Perplexity counts 79 answers because one round 3 answer was not captured. Linking another website is not wrong in itself; it means part of the answer rests on a page that is not the filing. Per-answer codes: citation-sources.json.

Round 2 head to head (filing named)

Blind round, 2026-11-10: answers out of 40 on each mark
MarkClaudeChatGPT
Rank of 6 (Octo ranked #1)#2#3
Figure correct4040
Cites a source4040
Source contains it4039
As-of date right4040
Total score160 / 160159 / 160
Answers with 4 of 44039
Wrong figures00
Strict reading of flagged calls (sensitivity check)about 155158

The strict-reading row is Signal8's own re-score of every call the graders flagged as lenient. On it ChatGPT would be ahead, which is one more reason to treat these two as close. Our ranking rule uses it only to separate equal scores, so Claude's higher blind score keeps it at #2 and ChatGPT at #3.

How each one was run

Run conditions, blind round
ToolSetupWhat happened
ClaudeClaude Opus 5.5, web search switched on, Signal8's own connectors switched offTwo early attempts with the connectors still on, and one cut off by a usage limit, were discarded and asked again.
ChatGPTFree plan, signed in, default modelAt question 6 it hit its file and analysis allowance and carried on text-only with web search.

Both got each question verbatim in a fresh chat with no follow-up. Answers were stripped of tool names and graded by eight fresh Claude instances against keys sealed before the run. That grader is the same model family as Claude, so a bias toward Claude-style answers cannot be ruled out. Every question named its filing, which made the test easier than real research, where you first have to find the right filing.

Every question

Marks out of 4 per question, blind round 2026-11-10
QCompany and topicClaudeChatGPT
R2-01VATE, ATM or warrants44
R2-02VEEA, ATM or warrants44
R2-03AZTR, ATM or warrants44
R2-04QNRX, ATM or warrants44
R2-05NTRP, ATM or warrants44
R2-06NNVC, ATM or warrants44
R2-07WKSP, ATM or warrants44
R2-08OGEN, ATM or warrants44
R2-09AIFF, ATM or warrants44
R2-10DRMA, ATM or warrants44
R2-11GANX, ATM or warrants44
R2-12PULM, ATM or warrants44
R2-13WHLR, Reverse split44
R2-14CDT, Reverse split44
R2-15VJET, Reverse split44
R2-16GOSS, Reverse split44
R2-17MYSZ, Reverse split44
R2-18ALCE, Reverse split44
R2-19BSFC, Reverse split44
R2-20CYCU, Reverse split44
R2-21SER, Cash and going concern44
R2-22JSPR, Cash and going concern44
R2-23MIRA, Cash and going concern44
R2-24CLRO, Cash and going concern44
R2-25TPST, Cash and going concern44
R2-26HLYK, Cash and going concern44
R2-27SDST, Cash and going concern44
R2-28ISPC, Cash and going concern44
R2-29GTBP, Shares and float44
R2-30ADGM, Shares and float44
R2-31SXTP, Shares and float44
R2-32CVKD, Shares and float44
R2-33BTLN, Shares and float44
R2-34POCI, Shares and float44
R2-35GTEC, Nasdaq notice (8-K)44
R2-36AUID, Nasdaq notice (8-K)44
R2-37BURU, Amended 10-Q44
R2-38PLUR, Offering terms44
R2-39LTRN, Insider purchase (Form 4)44
R2-40NSPR, Insider purchase (Form 4)43

The one row that differs is R2-40 (NSPR, a Form 4 purchase). The blind grader's note on ChatGPT's answer: 21,000 shares at $1.20 on May 12; cites an edgar-atlas listing URL that returned 403 to WebFetch, and no filing date or accession is named, so the source is unverified. All grader notes are in the blind round CSV.

What each vendor publishes

Plans as stated on each vendor's page, read Nov 9, 2026
Plan levelChatGPT (chatgpt.com/pricing)Claude (claude.com/pricing)
FreeIDR 0: "Unlimited text chats with GPT-6", limited uploads, limited deep research$0: limited usage every 5 hours and every week, web search yes, Research no
Entry paidGo, IDR 75,000 a month, may include adsPro, $20 a month ($17 on an annual plan), Research included
Mid paidPlus, IDR 349,000 a month, expanded deep researchMax, $100 a month, "5x Pro usage"
Top paidPro, from IDR 1,889,000 a monthUltra, $200 a month

ChatGPT's prices appear in rupiah because the page was read from Indonesia; Claude's in dollars. They are not converted here. ChatGPT reached 159 of 160 on its free plan.

Earlier: the pilot

In the pilot on 2026-11-09, ChatGPT's free plan answered 7 of 16 questions with full marks before its session logged out, and Claude answered none because the account was at its usage limit. The two shared no questions there, so the blind round is the first head to head.

What published research says

FinanceBench, a 10,231 question test about public companies (arXiv 2311.11944, November 2023), reported that GPT-4-Turbo with retrieval "incorrectly answered or refused to answer 81% of questions". Those models are old and that test did not name the filing in the question, so it is evidence that a filing fact needs checking, not a verdict on current ChatGPT or Claude.

How to check either one yourself

  1. Ask each tool for the filing form, date and accession number, then open that filing on EDGAR.
  2. Compare the "as of" date with the newest filing on the company's EDGAR page; a stale filing was the commonest wrong-figure cause across the tools we tested.
  3. Add classes of securities, or insiders, yourself rather than trusting one total.
  4. Run the same question in a fresh chat on both tools before you compare them.

Our top pick for SEC filing facts · joint top score in both blind filing rounds

Signal8 Octo, joint top score on SEC filing facts

Why Octo for filing questions: the top score in filing rounds 2 and 3 (316 of 320, shared with Claude, first on the published tie-break), zero wrong figures in 80 questions, and Octo cited the SEC filing itself on 77 of 80 answers and never relied on a third-party site. In the capability round (20 research jobs) it ranked second with 28 of 40, behind Claude (34) and ahead of ChatGPT (26). Claude vs ChatGPT vs Octo, side by side.

If your question is a filing fact about a US small cap, Signal8 Octo is the tool on this lab built specifically for it. It ranked #1 in both blind rounds: 316 of 320, the same as Claude and 12 above ChatGPT, with no wrong figure. Signal8 makes Octo and runs this lab, so weigh that result with the same caveats as the two above.

Signal8 makes Octo and runs this lab, so read its results beside the other rows. Octo and Claude scored the same in both filing-accuracy rounds; Octo is first there on Signal8's published tie-breaks, set after grading (round 2: Signal8's strict re-score of flagged calls; round 3: the two rounds' record of linking the original filing). In the earlier, non-blind pilot it finished one mark behind AskEdgar Studio (62 against 63 of 64). Octo is included in Signal8 Pro at signal8.ai/octo.

See Signal8 Octo