AnalogPortBench
Benchmarking LLMs on Analog Circuit Porting

Department of Electrical & Computer Engineering
University of Delaware
Benchmark flow: the porting task goes to an LLM; the returned SKY130 netlist is checked, simulated with ngspice and scored; INFEASIBLE answers are scored separately; simulation feedback allows up to three attempts.

TL;DR: Existing LLM benchmarks for analog circuit design all stay within a single technology node. AnalogPortBench tests whether state-of-the-art LLMs can port a working design from 0.18 µm to SKY130 (0.13 µm), and recognize when a specification is infeasible in the target technology.

Abstract

Analog circuit design still relies heavily on expert knowledge, and porting proven designs to new process nodes is a recurring bottleneck. As a lower supply reduces available voltage headroom, a working topology may require redesign or fail to meet specifications. While large language models (LLMs) have begun to generate and optimize analog circuits, existing benchmarks focus on one process node and assume feasible specifications.

To bridge this gap, we introduce AnalogPortBench, a benchmark of 54 tasks for porting ten circuits, from current mirrors to telescopic amplifiers, from a 0.18 µm process to the open-source SKY130 PDK. Tasks range from a direct port through a reduced supply and harder specifications to infeasible ones, and every feasible task has a reference design verified at five process corners. Evaluating six frontier LLMs at two reasoning levels, with and without simulation feedback, we find that models port simple circuits but rarely re-design headroom-sensitive amplifiers, seldom recognize infeasible specifications, and gain more from simulation feedback than from more samples or reasoning.

Benchmark

Ten circuits are ported in up to four tiers that add one difficulty at a time, so a failure can be traced to its cause. The circuits form three grades: G1 basic (current mirrors, cascode bias, 5T OTA), G2 medium (two-stage Miller and folded-cascode OTAs) and G3 headroom-sensitive (telescopic cascode OTAs).

TierVDD, specificationCorrect answerTasks
T11.8 V, from simulated sourcePorting meets all specification10
T21.2 V, voltage limits ×1.2/1.8Porting meets all specification12
T31.2 V, harder (reference exists)Porting meets all specification28
T41.2 V, beyond a physical boundINFEASIBLE + best effort4

Task tiers, all target SKY130 1.8 V low-threshold-voltage (LVT) devices, 54 tasks in total.

Results at a Glance

Pass rate at low and medium reasoning effort, and feasible tasks solved within three tries by resampling or with simulation feedback.

Left: share of answers that meet every specification on the 50 feasible tasks, with one try, at low and medium reasoning effort. Right: share of the 50 feasible tasks solved within three tries at medium effort, by the best of 3 samples or with simulation feedback.

Main Results

T1T2T3T4 / INFEASIBLESolved in 3 tries
ModelReasoning
effort
G1 (5)G2 (3)G3 (2) G1 (5)G2 (3)G3 (4) G1 (11)G2 (9)G3 (8) Flagged (4 tasks) ↑False alarms ↓ Re­samplingSimulation feedback
Naive port–20%0020%00000––––
OpenAI
GPT-6-lunalow40%0040%000006/1230/150––
medium40%0047%000002/121/15012%12%
GPT-6-sollow53%11%047%000006/121/150––
medium73%11%053%000006/120/15020%34%
GPT-6.1-sollow67%11%033%006%001/120/150––
medium73%017%53%08%21%002/120/15030%56%
Anthropic
Haiku 5.5low40%0027%000009/1220/150––
medium27%0033%000009/1220/1508%18%
Sonnet 5.5low60%0040%000006/123/150––
medium60%0040%000005/124/15012%26%
Opus 5.5low87%0060%0000011/122/150––
medium93%22%073%08%15%0010/120/15032%52%
Reference–100%100%100%100%100%100%100%100%100%––––

Zero-shot pass rate per tier and grade. Three samples per task, with task counts in parentheses. INFEASIBLE: answers declared infeasible for T4 tasks (correct, the higher the better) and feasible tasks (false alarms, the lower the better). Solved in 3 tries: rates of feasible tasks solved at medium effort by resampling (best of 3) or simulation feedback (up to 3 attempts). Best and second-best values in each column are highlighted.

Key Findings

RQ1. Can LLMs port a working design?

Partly, mainly for simple circuits. A naive port that only swaps device names passes 2 of the 54 tasks, and every LLM beats it. The best model, Opus 5.5, passes 93% of T1 answers on G1 circuits, but does not exceed 22% on G2 or G3, even at the original supply.

RQ2. What breaks when the headroom shrinks?

Lowering the supply from 1.8 V (T1) to 1.2 V (T2) cuts the pass rate of the two strongest models from 53% to 33% for Opus 5.5 and from 40% to 25% for GPT-6.1-sol, and the harder T3 tasks are rarely met. On the telescopic cascode OTA at 1.2 V, Sonnet 5.5 re-sized the stack and reached about 0.23 V of swing with three transistors in triode, while Opus 5.5 noted that the stack cannot reach the limit with all transistors in saturation, replaced it with a two-stage Miller OTA, and met every limit. A correct port here requires a topology change in addition to re-sizing.

RQ3. Do LLMs recognize infeasible specifications?

Opus 5.5 flags 10–11 of the 12 infeasible specifications with almost no false alarms. Haiku 5.5 and GPT-6-luna at low effort flag often but also raise false alarms on feasible tasks. More reasoning effort does not improve infeasibility detection, and GPT-6.1-sol, the strongest GPT model, ports well but rarely flags an infeasible specification, often returning designs that silently miss an unreachable limit.

RQ4. More reasoning or simulation feedback?

More reasoning helps only the strongest models while increasing token cost; the others gain little or nothing despite using up to 4.6× more tokens. Simulation feedback helps all models: for the two strongest, three feedback attempts solve over half of the feasible tasks, against about a third for the best of three samples, and raise solved T3 tasks from 2 to 13 (GPT-6.1-sol) and from 2 to 12 (Opus 5.5).

Pooled T1-T3 pass rate versus mean output tokens per answer, from low to medium reasoning effort, per model.

Pooled T1–T3 pass rate versus mean output tokens per answer, from low (open marker) to medium (filled) reasoning effort.

RQ5. Where in the design flow do designs fail?

The radar charts plot the design-flow steps clockwise. On G1 circuits, the shapes narrow at saturation and current error. On G2 circuits, the shapes stay wide except on gain, met by at most 16% of answers against up to 73% for stability, suggesting a gain–stability trade-off. On G3 circuits, the saturation axis separates the models, and even designs with all transistors in saturation lose gain.

Radar charts for grades G1, G2 and G3: valid netlist, circuit functions, all FETs in saturation, gain/current-error spec met, stability spec met, all specs met, and no false INFEASIBLE, per model.

Capability per circuit grade (zero-shot, medium effort, T1–T3); each axis is scored independently on a square-root radial scale.

BibTeX

@article{rajabi2026analogportbench,
  title={AnalogPortBench: Benchmarking LLMs on Analog Circuit Porting},
  author={Rajabi, Saeid and Moussa, Aly and Saxena, Vishal and Yang, Chengmo and Patnaik, Satwik},
  journal={arXiv preprint arXiv:2610.33088},
  year={2026}
}