SkillChirp
CAREER PROJECT · Intermediate · 1–2 weekends

A/B Experiment Analysis Toolkit

Analyze experiments with guardrails, confidence intervals, segmentation and clear decision rules.

StatisticsPythonSQLExperimentsCommunication
DEFINITION OF DONE

Leave artifacts a reviewer can inspect.

01

Analysis notebook

Make this concrete enough that another engineer can understand what you built and why.

02

Synthetic dataset

Make this concrete enough that another engineer can understand what you built and why.

03

Decision template

Make this concrete enough that another engineer can understand what you built and why.

04

Guardrail metrics

Make this concrete enough that another engineer can understand what you built and why.

05

Visualization

Make this concrete enough that another engineer can understand what you built and why.

RESUME / PORTFOLIO FRAMING

Describe what you actually did.

Built a reproducible experiment-analysis toolkit with uncertainty estimates, guardrails and decision-focused reporting.

Use this as a starting structure, then replace it with your real implementation details, metrics and constraints. Do not claim outcomes you did not measure.

Validate the shipped project →
STRETCH GOALS

Go deeper if the core is already solid.

Power analysis

Add only if it strengthens the engineering story instead of delaying a finished, deployable core.

Sequential testing

Add only if it strengthens the engineering story instead of delaying a finished, deployable core.

CUPED

Add only if it strengthens the engineering story instead of delaying a finished, deployable core.