Skip to content
PartsPlan AIPartsPlan AI

Datasheet question tests

Tests of whether the AI finds and reads datasheet values exactly. The same AI got the same questions, and answers were checked against the printed datasheet pages. Each table lists its conditions and dates.

01 · 8 design questions

We tested it

We gave the same AI the same 8 design questions. The answers sit in tables deep inside 30–330 page datasheets. Correct answers were checked against the printed datasheet pages. (September 25–27, 2026)

Swipe sideways to compare with the other methods →

With PartsPlan MCPWeb search onlyService AService BDistributor parts APIs
Correct value and printed page
8 / 8
6 / 8
2 / 8
0 / 8
0 / 8
Wrong values
0
0
0
0
—
Not found
0
2
330- and 109-page docs
6
part not held
8
new parts still waiting for extraction
8
field not in response
Tool calls
21
62
26 failed fetches
24
—
—
Web search re-run (September 27)
—
7 / 8
8.4 min (relied on third-party copies)
—
—
—
  • This is a small test. We chose the 8 documents (not random), so it does not represent accuracy across all parts.
  • The web-search side got its 6 only after finding an external service that converts PDFs to text.
  • Service A got its 2 right on both value and page, and did not have the other 6 parts. Service B extracts parts it has not seen on the fly, and on a free account that extraction did not finish.
›What we asked
  1. PIC16F917 — θJA of the 40-pin PDIP package
  2. AT32UC3C1256C — θJA of the 100-pin TQFP
  3. ADuM1400 — maximum working insulation voltage VIORM, 16-pin SOIC_W
  4. MCP1825 — θJA of the 5-pin SOT-223
  5. LTC3615 — θJA of the 24-pin TSSOP
  6. MIC5209 — θJA of the 8-pin SOIC
  7. R1191L — power dissipation on the standard board, and its package
  8. MAX1541 — thermal shutdown threshold
02 · 30 graph values

Even values that exist only in graphs

We asked for simulation thermal/loss model data for one power IGBT (Infineon IKW40N120CS6). The 30 conduction-voltage, switching-loss and diode-voltage values are not in any table — only in graphs. Correct answers were worked out separately from the original datasheet graphs. (September 26, 2026)

Swipe sideways to compare with the other methods →

With PartsPlan MCPPDF attachedWeb search only
Graph values correct (within 3% or 0.05 V) of 30
30 / 30
25 / 30
5 / 30
Average / max error
0.3% / 3.3%
2.0% / 6.7%
—
Not found
0
0
24
couldn't see graphs
Thermal model table, 11 terms
11 / 11
10 / 11
one digit misread
11 / 11
Same task repeated 6 times
30 / 30 all 6 times
—
—
  • This test used a single part (a 16-page document). It does not guarantee the same accuracy on other documents or graphs.
  • All three used the same AI model. 'PDF attached' means the user found and uploaded the datasheet themselves; that time is not included.
  • The web-search side left missing values blank rather than inventing them; it found the 40 A values printed in tables.
›What we asked for
  1. IGBT conduction voltage — VGE=15V, 10/20/40/60/80 A, 25°C and 175°C (pick the 15V curve out of 7)
  2. Switching losses Eon/Eoff — 10/20/40/60/80 A
  3. Diode forward voltage — 10/20/40/60/80 A, 25°C and 175°C (solid and dashed)
  4. Thermal impedance Foster network — 6 IGBT terms, 5 diode terms
03 · 12 hard questions

12 hard design questions — the only perfect score, four runs out of four

Twelve questions on deep tables in long datasheets, values that only exist in graphs, and package-drawing dimensions. Each has a plausible wrong value right next to it (a curve for another temperature, a neighbouring row). Same AI, same questions; truths confirmed from the original pages and graphs. We scored only how accurately each method read a document — not how many parts it holds. Service A was its public API without login; Service B its official MCP on a free account. (September 26–27, 2026)

Swipe sideways to compare with the other methods →

With PartsPlan MCPPDF attachedService AService BWeb search
Correct out of 12
12 / 12
10 / 12
5.5 / 12
—
10 / 12
Of which 5 graph values (curves for other conditions sit next to the right one)
5 / 5
3 / 5
read by eye, 8% and 15% off
0 / 5
could not read figures
—
3 / 5
one from the neighbouring curve
Wrong values
0
2
0
—
2
Same result when run again? (ours 4 runs · PDF attached 3 runs)
12 / 12 in all 4 runs
10, 11, 10
1–2 graph values off each time
—
—
—
With a small, fast AI model (one question at a time)
8.5 / 12
3 wrong
graphs 3 / 5
7 / 12
5 wrong
graphs 1 / 5
—
—
—
  • Web search answered one graph question with the 25 °C curve next to the requested 125 °C curve, and used a third-party copy when the manufacturer site timed out.
  • Service B could not take this test because the free account ran out of extraction quota and credits ("—"), so the "only perfect score" compares the other four methods. We do not name the services. These are small tests.
›Parts used
  1. ST STM32F103C8T6 (114 pages) · TI LM358DR · Diodes AP2112K-3.3 · onsemi BSS138 · onsemi SS34
  2. e.g. drain current on the 125 °C, VGS 1.75 V curve; dropout at 400 mA on the 85 °C curve; maximum LQFP48 lead width
04 · Real-world jobs

The jobs people actually hand to AI — part review, alternatives, Chinese parts

We tested with the work designers actually give their AI. On easy jobs other methods matched us, and the difference was evidence (the original page) and time. The gap grew with rarer documents, graphs and look-alike values. (September 26–27, 2026)

Swipe sideways to compare with the other methods →

PartsPlan only (web search off)Service AService BWeb searchAI without tools
Reviewing a 30-part BOM — 6 hidden violations visible only from datasheet values
6 / 6
1.9 min
$1.75
2 / 6
$1.46 (documents for 9 of 30)
—
6 / 6
12.2 min
$5.42
6 / 6
1 min
$0.23 (no page evidence, one remembered value wrong)
10 questions on 6 parts from Chinese makers — WCH, Microne, SGMICRO, XLSEMI, TPOWER, incl. Chinese-language datasheets
10 / 10
1.5 min
$1.24
0 / 10
no documents
—
8 / 10
2.6 min
$1.84 (one graph value off)
0 / 10
$0.17 (mostly said it did not know)
Key values of Raspberry Pi Pico board parts, 8 questions
8 / 8
0 / 8
2 / 8
mostly waiting for extraction
8 / 8
—
Same Pico 8 questions — with web search on, plus PartsPlan (October 1 · 1 run)
8 / 8
1.7 min
$1.50
0 web search calls
—
—
—
—
One alternative part — find a pin-compatible candidate and confirm pins and ratings with pages
45 s
$0.56
both pin tables checked in the originals
—
—
3.1 min
$1.05
could not read the candidate's pin table; used search summaries
—
Same 9 — candidates from Service A, verified with ours
4.1 min
$3.33
5 drop-ins
—
—
—
—
Same 9 — with web search on, plus PartsPlan (October 1 · 1 run)
4.8 min
$2.79
6 drop-ins
0 web search calls
—
—
—
—
8 values the datasheets do not contain, mixed in — values made up
0
0
—
0
could not open 2 ST documents
0
8 parts both hold — absolute maximum supply voltage
8 / 8
$1.19
8 / 8
$1.04
7 / 8
one wrong · no pages given
—
—
Same 8 parts — reading pinout and package drawings
8 / 8
1.3 min
$0.95
8 / 8
2.1 min
$2.04
7 / 8
—
—
Design review of 8 parts — 6 planted errors and 4 correct items
10 / 10
10 / 10
—
—
—
Published accuracy measurement
Published
Not found
Not found
—
—
  • On easy table values and pinouts, Service A matched us. The violations in a BOM of well-known parts were also found by the AI from memory (without page evidence, and with one remembered thermal-resistance value wrong). On such jobs our difference is page evidence and time.
  • When values the datasheets do not contain were mixed in, no method made one up — current AI says when it does not know. The risk we saw was not invented values but a similar, different value (the next curve, another temperature, another revision) used as the right one.
  • Costs are the same AI model's usage fee (USD, one run), excluding each service's own pricing. We do not name the services. These are small tests.
›What we used
  1. BOM: a 24 V industrial sensor board, 30 parts — input overvoltage, LDO current too low, commercial temperature grade (0–70 °C), a MOSFET that 3.3 V cannot turn on, op-amp input range, diode current
  2. Chinese parts: WCH CH340G · Microne ME6211 · SGMICRO SGM2019, SGM321 · XLSEMI XL1509 · TPOWER TP4056
05 · With web search

Web search alone vs. web search + PartsPlan — graphs, footnotes, hidden addresses

We asked the same AI (Claude Opus 5.5) the same 4 design questions 3 times each: one side with web search only, the other with web search plus PartsPlan. October 2, 2026 · 3 runs each.

Swipe sideways to compare with the other methods →

Web search + PartsPlanWeb search only
TPS563200 buck — 2 A continuous at 85 °C ambient? (derating curve)
Conclusion 3 / 3
1.86 A
82 °C (same in all 3 runs)
cited page 3 / 3
Conclusion 3 / 3
about 1.8–1.9 A
about 80–84 °C
cited page 3 / 3
G5LE relay — sure to pull in at 85 °C? (23 °C coil footnote)
Conclusion 3 / 3
cited page 3 / 3
Conclusion 3 / 3
cited page 3 / 3
Five I²C parts on one bus — address clashes and the address to avoid (0x70)
Conclusion 3 / 3
cited page 3 / 3
Conclusion 3 / 3
cited page 0 / 3
MOSFET hot-swap — fault timer limit (SOA graph)
Conclusion 3 / 3
1.8 ms (1 ms or less recommended)
cited page 3 / 3
Conclusion 2 / 3
the 3 runs differed: 0.5 ms
about 4 ms (outside the 85 °C safe area)
1 ms
cited page 3 / 3

Each question in plain words

① Can a power chip deliver 2 A in a hot place?

The TPS563200 is a power chip that turns 12 V into 5 V. In hot surroundings it can deliver less current, and how much less is only in a graph on page 11 of the datasheet. We asked whether it can deliver 2 A continuously at 85 °C.

Both sides answered correctly all 3 times ("not at 85 °C") and cited that graph's page. Web search alone read the graph by eye and gave ranges ("about 1.8–1.9 A, up to 80–84 °C"); with PartsPlan all 3 runs gave the same values ("1.86 A, up to 82 °C").

→ For a well-known part with an easy-to-get public PDF, web search alone gets it right. The difference is how precise the numbers are, and whether you get the same value every time.

② Will a relay reliably switch on in a hot place?

Page 3 of the relay datasheet has a small footnote: coil values are at 23 °C. When it is hot, like 85 °C, the coil's resistance rises, so the same voltage may no longer switch the relay on reliably.

Both sides answered correctly all 3 times ("not guaranteed at 85 °C — the coil is about 0.2 V short") and cited the source page with that footnote.

→ Here both sides scored the same: if the AI opens the datasheet and checks that footnote, web search alone can get it right.

③ Can five parts share one communication line?

I²C lets several parts share two wires, and each part's "address" must be different. The PCA9685 also uses a shared address, 0x70, from the moment it powers up — this is only explained on page 8 of its datasheet.

Both sides found the 2 clashing address pairs and 0x70 all 3 times. Web search alone answered from memory all 3 times without opening the datasheets and gave no page; with PartsPlan the AI cited the document and page for all 5 parts.

→ AI can answer well-known parts from memory. But memory can be wrong with no way to check, so a design review needs the page.

④ After a short circuit, how fast must the power switch cut off before it burns?

The SOA is the range of voltage, current and time a part can survive without burning. We asked the AI to read the SOA graph on page 6 (a chart with logarithmic scales) and say how many milliseconds the protection circuit has to cut off a 30 A short.

Web search alone gave a different answer each of the 3 times: "0.5 ms or less" (safe, but far shorter than the real limit), "a theoretical limit of about 4 ms, 2 ms or less recommended" (at 85 °C the part cannot survive 30 A for 4 ms), and "1 ms or less recommended". With PartsPlan all 3 runs gave the same answer: "a limit of about 1.8 ms, 1 ms or less recommended".

→ If a misread graph number becomes the design value, the part can burn in a real fault. Graph numbers are where adding PartsPlan changes the answer most.

  • A small test: 4 questions, 3 runs each.
›Questions used
  1. TPS563200, 12 V → 5 V at 2 A continuous, up to 85 °C ambient — does 2 A hold, and up to what temperature
  2. Omron G5LE-1 DC5 driven by an NPN (VCE 0.3 V) from 5 V ±5 % — is pull-in guaranteed at 85 °C
  3. INA219, BME280, DS3231, MPU-6050 and PCA9685 on one I²C bus with default address pins — clashes, fix, addresses to avoid
  4. 12 V hot-swap with CSD18540Q5B · 2200 µF · 10 ms ramp · 30 A short with a 10 ms fault timer — inside the SOA, and the timer limit (incl. 85 °C case)
06 · A datasheet site's chat

We asked a datasheet site's chat feature the same 12 questions — it cited the right pages, but 5 of 6 graph values were outside ±3 % of the truth

Service C is the AI chat that a datasheet site offers on each part page. We asked it the 12 questions from the tables above (4 from the web-search comparison · 6 hard questions · 2 values that are not in the datasheet) in English with the same instructions the PartsPlan side had, once each and without logging in (October 3, 2026 · the shared-address question on October 2). Graph values counted as correct only within ±3 % of the truth. The PartsPlan column shows our results for the same questions from the tables above, with the conditions (web search on or off · date · runs) written in each cell.

Swipe sideways to compare with the other methods →

With PartsPlan MCPService C
TPS563200 buck — 2 A continuous at 85 °C ambient? (derating curve)
3 / 3
1.86 A
82 °C (web search + PartsPlan · October 2, 3 runs)
Right page, wrong conclusion
said 'it can'
85 °C: 2.2 A
2 A up to 88 °C (truth 1.86 A · 82 °C)
G5LE relay — sure to pull in at 85 °C? (23 °C coil footnote)
3 / 3
not guaranteed, about 0.2 V short (web search + PartsPlan · October 2, 3 runs)
Correct
not guaranteed, about 0.2 V short
stated the coil-resistance temperature coefficient as an assumption and calculated
PCA9685 — the shared address it answers right after power-up (0x70)
3 / 3
0x70 (in the question with all 5 parts · web search + PartsPlan · October 2, 3 runs)
No answer
the document on that part page is a product leaflet, not the datasheet (October 2)
CSD18540 hot-swap — short-circuit timer limit at an 85 °C case (SOA graph)
3 / 3
about 1.8 ms, 1 ms or less recommended (web search + PartsPlan · October 2, 3 runs)
'10 ms is outside the SOA' was right
graph value wrong (10 ms limit 8 A, truth 22.1 A)
85 °C limit 'under 1 ms' (truth about 1.8 ms)
STM32F103C8T6 — max Stop-mode current at 105 °C (a table in a 114-page document)
4 / 4
PartsPlan only · web search off · September 27, 4 runs
Correct
340 µA
LM358DR — output current limit at 70 °C (graph)
4 / 4
PartsPlan only · web search off · September 27, 4 runs
Wrong
about 34 mA (truth 29.4 mA)
right curve and page
AP2112K-3.3 — dropout at 85 °C · 400 mA (graph)
4 / 4
PartsPlan only · web search off · September 27, 4 runs
Correct
200 mV
BSS138 — on-resistance at 125 °C · VGS 3.3 V (graph)
4 / 4
PartsPlan only · web search off · September 27, 4 runs
Wrong
about 2.1 Ω (truth 1.95 Ω)
right curve and page
BSS138 — drain current at 125 °C · VGS 1.75 V (graph)
4 / 4
PartsPlan only · web search off · September 27, 4 runs
Wrong
about 0.1 A (truth 0.117 A)
right graph and page
AP2112K-3.3 — EN pin and what to do with pin 4 (pinout)
4 / 4
PartsPlan only · web search off · September 27, 4 runs
Correct
EN is pin 3
pin 4 left unconnected
BSS138 — avalanche energy (not in the datasheet)
Said it is not there (PartsPlan only · web search off · September 27, 1 run)
Said it is not there
nothing made up
AP2112K-3.3 — output-capacitor ESR range (not in the datasheet)
Said it is not there (PartsPlan only · web search off · September 27, 1 run)
Said it is not there
nothing made up
Total
All correct
web search + PartsPlan 4 questions · October 2, 3 runs each · PartsPlan only 8 questions · September 27, 4 runs, missing values 1 run
6 / 12
graph values 1 / 6
all 11 cited pages right

In plain words

① Values read from graphs — the right page, but different numbers

We asked 6 values that exist only in graphs, such as current that changes with temperature or how long a part survives. In 5 of the 6 graphs, curves for other conditions sit right next to the right one.

Service C found the right graph and page for all 6. But only 1 number was right. Asked whether 2 A can be delivered continuously at 85 °C ambient, it said 'it can (2.2 A at 85 °C)', while the same graph shows 1.86 A.

→ When the cited page is right, the whole answer looks checked. A design that trusts that answer runs 2 A at 85 °C past the limit the graph shows.

② Tables · pinouts · missing values — correct

We asked a value from a table in a 114-page document, pin numbers, and 2 values that are not in the datasheet at all.

Service C got the table value and the pinout right, and honestly said the 2 missing values are not in the datasheet.

→ Values printed as text can be found and read as long as the right document is there.

③ Questions that need a judgement — the relay right, a different document for the shared address

We asked whether a relay reliably switches on when hot (judged from a footnote saying coil values are at 23 °C), and which shared address (0x70) a part answers right after power-up.

For the relay it stated the assumption that coil resistance rises with temperature, calculated, and correctly answered 'not guaranteed' (a day earlier, asked without the instructions, it gave no conclusion). For the shared address, that part page carried a product leaflet instead of the datasheet, so it could not answer.

→ Design questions need a yes or no. When a question needs an assumption from outside the datasheet, the answer reaches a conclusion only by stating it and calculating.

  • Service C got the printed table values and the pinout right, and said the 2 values that are not in the datasheet were not there (0 values made up). On the relay question it stated an assumption from outside the datasheet (the coil-resistance temperature coefficient), calculated, and got it right.
  • For all 6 graph values it found the right graph and page, but only 1 number was within ±3 % of the truth. On the 2 A question it reached the wrong conclusion ('it can'), and it set the short-circuit timer limit at 'under 1 ms', shorter than the truth (about 1.8 ms). With a ±10 % tolerance Service C would score 7 / 12, and the PartsPlan column would still be all correct.
  • A day earlier (October 2), asked the same questions without the instructions, it scored 5 / 12. Then too only 1 of the 6 graph values was right, but a different one (LM358 then, AP2112K this time); the 2 A question was answered 'it cannot' (right) and the short-circuit timer limit was 5.6 ms (about 3 times the truth). Answers to the same question changed from run to run.
  • The shared-address question went unanswered on October 2 because that part page carried a product leaflet instead of the datasheet, and we did not ask it again. Response times measured on October 2: 10 of 12 answers within 80 seconds (4 within 20 seconds), the other 2 in about 2.5 minutes and under 5 minutes. Without logging in, the site allows 20 questions a day.
  • The PartsPlan column repeats results from the tables above for the same parts and conditions (Claude Opus 5.5 with PartsPlan connected); Service C uses the AI that site provides, so the AI differs too. The conditions differ by cell, and the web-search comparison questions were put to Service C in English. Service C was asked each question once — a small test. We do not name the service.
›Questions asked
  1. 3 questions from the web-search comparison (table 05) — the PartsPlan-side wording translated into English with the same closing line ('if you make any assumptions beyond the datasheet, state them') · the shared-address question (PCA9685) is the October 2 result, asked for that one part
  2. 6 of the 12 hard questions (table 03) — with the same instructions as the PartsPlan side (the manufacturer's datasheet only · read the curve for the asked condition · say 'not found' if unknown): STM32F103C8T6 table · LM358DR, AP2112K-3.3 and BSS138 graphs · AP2112K-3.3 pinout
  3. 2 values that are not in the datasheet — BSS138 avalanche energy · AP2112K-3.3 output-capacitor ESR range (same instructions)