ablation-design
Design ablation studies to isolate component contributions in ML systems
适合你，如果你需要量化机器学习系统中每个模块的独立作用
npx oh-my-skill add yogsoth-ai/de-anthropocentric-research-engine/ablation-designcurl -fsSL https://oh-my-skill.com/install.sh | bash -s -- yogsoth-ai/de-anthropocentric-research-engine/ablation-designnpx oh-my-skill verify yogsoth-ai/de-anthropocentric-research-engine/ablation-design怎么用
商店整理自技能原文 · 版本 59ace64 · 表述以原文为准装上后，Claude 能帮你设计消融实验：拆解机器学习系统的组件，逐一移除或替换，来测量每个组件对整体性能的贡献。它会引导你完成组件映射、基线选择、指标定义等步骤。
当你需要分析机器学习系统中不同组件的影响时触发。例如，你提出“我想知道我的模型哪些部分最重要”或“帮我设计一个消融实验”时。
技能原文 SKILL.md
Strategy: Ablation Design
Question: What does each component contribute?
Methodology
- Systematic Ablation (Newell 1974): Remove one component at a time, measure degradation.
- Replacement Ablation: Replace component with simpler alternative to isolate contribution.
- Combinatorial Ablation (ABLATOR): Test component subsets to detect interaction effects.
- Conditional Ablation: Ablate components under specific data conditions to find context-dependent contributions.
Execution Flow
- ablation-component-mapping → Map system architecture to ablatable units
- baseline-selection → Select full-system and minimal-system anchors
- metric-specification → Define metrics that capture component contribution
- sample-size-estimation → Determine runs needed for reliable delta estimation
- statistical-method-selection (tactic) → Choose appropriate significance tests for deltas
Budget Gate
| Ablation Type | Components (N) | Min Runs | When to Use | |---------------|---------------|----------|-------------| | Systematic (leave-one-out) | 3-8 | N + 2 | Standard component analysis | | Replacement | 3-8 | 2N + 2 | Need to distinguish "removal" vs "simplification" | | Combinatorial (selected) | 4-6 | ~2N | Suspected interactions between components | | Combinatorial (full) | 3-4 | 2^N | Small systems, need complete picture | | Conditional | 3-6 | N * conditions | Context-dependent contributions |
<!-- BEGIN available-tables (generated) -->
Available Tactics
Optional, no fixed order; the final leaf is always a sop.
| Tactic | When to use | | --- | --- | | statistical-method-selection | Select appropriate statistical methods for experiment analysis |
Available SOPs
Optional, no fixed order; the final leaf is always a sop.
| SOP | When to use | | --- | --- | | ablation-component-mapping | Map system architecture to ablatable units for ablation studies | | baseline-selection | Select appropriate baselines for experimental comparison | | metric-specification | Define experiment metrics and significance standards | | sample-size-estimation | SOP: power analysis and required experiment count estimation |
<!-- END available-tables (generated) -->