Files
16gagent/docs/reports/benchmark-report.md
T
2026-06-06 10:40:48 +08:00

411 lines
8.0 KiB
Markdown

# Domain Benchmark Report
> Generated: 2026-06-05T07:36:27.230Z
> System: project-intake-agent → architecture-agent → frontend-builder → backend-builder → fullstack-composer
## Summary
| Metric | Value |
|--------|-------|
| Total Domains | 10 |
| Frontend Generated | 10/10 |
| Backend Generated | 10/10 |
| Fullstack Composed | 10/10 |
| Frontend Build PASS | 10/10 |
| Backend Typecheck PASS | 10/10 |
| CRUD PASS | 10/10 |
| Auth PASS | 10/10 |
## Timing
| Phase | Avg Time |
|-------|----------|
| RequirementPackage | 0.1s |
| Frontend Builder | 0.1s |
| Backend Builder | 0.1s |
| Fullstack Composer | 0.1s |
| **Total Pipeline** | **20.1s** |
## Files Generated
| Layer | Avg Files |
|-------|-----------|
| Frontend | 31 |
| Backend | 25 |
| Fullstack | 67 |
## Domain Results
| Domain | FE Gen | BE Gen | FS Gen | FE Build | BE Typecheck | CRUD | Auth | Total Files | Time |
|--------|--------|--------|--------|----------|-------------|------|------|-------------|------|
| petcare | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 138 | 16.8s |
| crm | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 120 | 19.0s |
| inventory | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 140 | 16.3s |
| ticket | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 138 | 14.7s |
| blog-cms | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 112 | 16.6s |
| project-mgmt | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 102 | 15.6s |
| hr | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 138 | 15.4s |
| asset | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 102 | 18.1s |
| course | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 134 | 39.1s |
| appointment | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | 102 | 29.8s |
## Detailed Results
### petcare
**Input:** "做一个宠物护理管理平台,宠物主人可以管理宠物档案、健康日程、日常记录和成长相册"
**Project:** PetCare | **Domain:** pet
#### Frontend
✅ 37 files generated
#### Backend
✅ 26 files generated
#### Fullstack
✅ 75 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### crm
**Input:** "做一个客户关系管理系统,支持客户管理、销售漏斗、跟进记录和数据分析仪表盘"
**Project:** NoteApp | **Domain:** note
#### Frontend
✅ 28 files generated
#### Backend
✅ 26 files generated
#### Fullstack
✅ 66 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### inventory
**Input:** "做一个库存管理系统,支持商品入库出库、库存盘点、供应商管理和库存预警"
**Project:** ShopApp | **Domain:** ecommerce
#### Frontend
✅ 35 files generated
#### Backend
✅ 29 files generated
#### Fullstack
✅ 76 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### ticket
**Input:** "做一个工单系统,支持工单创建、分配、处理流程、优先级管理和工单归档"
**Project:** OAFlow | **Domain:** enterprise
#### Frontend
✅ 34 files generated
#### Backend
✅ 29 files generated
#### Fullstack
✅ 75 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### blog-cms
**Input:** "做一个博客内容管理系统,支持文章发布、分类标签、评论管理和媒体库"
**Project:** SocialApp | **Domain:** social
#### Frontend
✅ 30 files generated
#### Backend
✅ 20 files generated
#### Fullstack
✅ 62 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### project-mgmt
**Input:** "做一个项目管理系统,支持项目看板、任务分配、甘特图和团队协作"
**Project:** MyProject | **Domain:** generic
#### Frontend
✅ 25 files generated
#### Backend
✅ 20 files generated
#### Fullstack
✅ 57 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### hr
**Input:** "做一个人力资源管理系统,支持员工档案、考勤管理、招聘流程和绩效评估"
**Project:** OAFlow | **Domain:** enterprise
#### Frontend
✅ 34 files generated
#### Backend
✅ 29 files generated
#### Fullstack
✅ 75 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### asset
**Input:** "做一个固定资产管理系统,支持资产登记、领用归还、折旧计算和盘点统计"
**Project:** MyProject | **Domain:** generic
#### Frontend
✅ 25 files generated
#### Backend
✅ 20 files generated
#### Fullstack
✅ 57 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### course
**Input:** "做一个在线课程管理系统,支持课程发布、章节管理、学员进度和作业批改"
**Project:** EduPlatform | **Domain:** education
#### Frontend
✅ 32 files generated
#### Backend
✅ 29 files generated
#### Fullstack
✅ 73 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
### appointment
**Input:** "做一个预约管理系统,支持服务项目、时间段预约、客户通知和预约统计"
**Project:** MyProject | **Domain:** generic
#### Frontend
✅ 25 files generated
#### Backend
✅ 20 files generated
#### Fullstack
✅ 57 files generated
#### Build
✅ Frontend build: PASS
✅ Backend typecheck: PASS
#### API
| Endpoint | Status |
|----------|--------|
| Health | ✅ |
| Register | ✅ |
| Login | ✅ |
| Me | ✅ |
| Create | ✅ |
| Read | ✅ |
| Update | ✅ |
| Delete | ✅ |
## Failure Analysis
**All domains passed all checks!**
## Pattern Analysis
### Best Performing Domains
| Domain | Score | Key Strength |
|--------|-------|-------------|
| petcare | 13/13 | pet |
| crm | 13/13 | note |
| inventory | 13/13 | ecommerce |
### Weakest Domains
| Domain | Score | Key Issue |
|--------|-------|-----------|
| appointment | 13/13 | — |
| course | 13/13 | — |
| asset | 13/13 | — |
### Domain Type Analysis
| Domain Type | Count | Avg Score |
|-------------|-------|-----------|
| pet | 1 | NaN |
| note | 1 | NaN |
| ecommerce | 1 | NaN |
| enterprise | 2 | NaN |
| social | 1 | NaN |
| generic | 3 | NaN |
| education | 1 | NaN |
## Required Fixes
### P0 — Critical
✅ No critical issues found.
### P1 — High
✅ No high-priority issues found.
### P2 — Medium
✅ No medium-priority issues found.
## Conclusion
⚠️ **0/10 domains fully passed.**
The pipeline shows partial generalization. 10 domains need fixes before the system can be considered a truly general Web Fullstack Generator.
**Electron Builder should wait until fixes above are addressed.**
---
*Report generated by Domain Benchmark Suite*