Key points
- Two open-source strategies diverged in 2026: Qwen3.8-27B (dense 27B, 48 Gated DeltaNet layers + 16 full-attention layers, MTP, Apache-2.0, native text/image/video, runs on a single 16GB GPU after quantization) versus DeepSeek-V4-Flash (284B MoE, 13B active per token, DSpark speculative decoding, MIT, text-only, 1M native context / 384K max output, ~160GB at FP4). On a per-token basis Qwen is heavier, which explains why DeepSeek can undercut on price while 27B feels like a larger model.
- Tool calling is the make-or-break agent capability. Qwen uses Schema Embedding tokenization, Toolformer-style action heads, and Action Consistency Loss; OpenRouter production traffic shows a 1.06% tool-call error rate but a 17.52% structured-output error rate. Qwen remains the recommended tier on Berkeley BFCL. DeepSeek rebuilt post-training around tools (Toolathlon Verified rose from 51.8 preview to 70.3) and supports Responses API with Codex-targeted tuning. Integration pitfalls: requests with
toolsmust echo backreasoning_contentor APIs return 400, and the JSON mode occasionally emits empty content (an open bug). - Code and terminal: V4 Flash leads, same-size Qwen crushes its predecessor. Terminal-Bench 2.1: DeepSeek 82.7 vs Qwen 73.0. DeepSWE 1.1: 54.4 vs 42.2. DeepSeek improved DeepSWE roughly 7x from preview. Qwen excels at write-and-pass tests: LiveCodeBench v6 90.3 (above Opus 4.6 Max 88.8), SWE-bench Pro 61.7 under Claude Code harness (above Opus 4.6 Max 53.4). A 27B model beating larger Qwen 3.7-Plus and some closed flagships signals agent capability descending to consumer GPUs.
- Computer-use is Qwen's exclusive turf. Native multimodality lets it consume screenshots/UI frames directly: OSWorld-Verified 84.3 (vs Opus 4.6 Max 72.7), AndroidWorld 81.9, WebArena-Verified 64.8, SWE-MM 38.6. DeepSeek is text-only and physically incapable of screenshot-driven computer use; its strengths stay in terminal, repo, and long-document tasks.
- Third-party cross-checks are essential. WildClawBench (60-agent-task OpenClaw eval) gives Qwen3.8-27B 48.0%, ranking 15 of 33, roughly halving vendor figures under a stricter harness, still well above predecessors. DeepSeek has independent backing: Artificial Analysis Intelligence Index 50 post-0731, LMArena hard ~1459 Elo, and an independent Terminal-Bench of 79% versus official 82.7 (small gap, high credibility). Qwen's biggest gap is the absence of any independent intelligence index; every number is still Alibaba self-reported.
- Cost economics: compare completed-task cost, not sticker price. DeepSeek cache-miss pricing $0.14/$0.28 per million tokens (from 2026-08-16, peak/off-peak tiers; off-peak half price). Qwen API $0.45/$3.20 but self-hosting is near zero with on-prem data. A complementary routing pattern emerges: DeepSeek for long-context text and terminal work, Qwen for image/video, self-hosted Qwen as the baseline with rental for spikes.
- Industry signal. Agent capability used to be locked behind closed-source giants and cloud APIs. In 2026, open-weight vendors pushed core capability into hundreds-of-billions dense models, and 27B became the recognized 'gold tier': controllable hardware, stable inference, multimodal plus long context. Caveats: both lag Opus 4.7, GPT-5.5, and GLM-5.1 by 20+ points on end-to-end benchmarks like WildClawBench and SWE-bench Verified. Crucially, scaffold choice can swing scores by ~22% versus ~1% for model choice, so build the harness before optimizing the model.
- Architectures
- DeepSeek V4 Flash: 284B total / 13B active MoE, DSpark speculative decoding, MIT, ~160GB FP4 weights
- Qwen3.8-27B: dense 27B, 64 layers (48 Gated DeltaNet + 16 full-attention) with MTP, Apache-2.0, single-GPU 16GB deployment, 8GB viable when heavily quantized
- Tool calling
- Qwen: OpenRouter tool-call error 1.06%, structured-output error 17.52%
- DeepSeek: Toolathlon Verified 70.3 (up from 51.8 preview)
- Terminal / code
- Terminal-Bench 2.1: 82.7 vs 73.0 (DeepSeek lead)
- DeepSWE 1.1: 54.4 vs 42.2
- Qwen LiveCodeBench v6: 90.3; SWE-bench Pro: 61.7 (Claude Code harness)
- Multimodal agents
- Qwen OSWorld-Verified 84.3; AndroidWorld 81.9; WebArena-Verified 64.8; SWE-MM 38.6
- DeepSeek absent (text-only)
- Third-party anchors
- WildClawBench Qwen: 48.0% (15/33)
- DeepSeek AA Index 50; independent Terminal-Bench 79%
- Cost
- DeepSeek: $0.14 / $0.28 per million tokens (peak/off-peak)
- Qwen API: $0.45 / $3.20; self-hosted ~0
Bulleted findings
Mandatory caveats
1. All benchmarks use vendor harnesses with no public head-to-head on identical scaffolds; test in production conditions before committing.
2. Qwen lacks any independent intelligence index; numbers await third-party reproduction. DeepSeek has AA backing but still relies on vendor harnesses.
3. DeepSeek integration pitfalls: tools requests must echo reasoning_content or return 400; JSON mode occasionally returns empty content.
4. Qwen structured-output error rate 17.52%, so strong-JSON scenarios need application-side schema validation as a safety net.
5. Multi-step accuracy compounds downward (single-call 90% → ~59% after 5 calls); agents require built-in retry, feedback, and parameter validation.
6. Qwen local deployment slows down and occasionally repeats past ~80K tokens; long-context agents need memory budgeting and segmentation.