By Team Edtoolkits · Data
Compare conversion rates with intervals, uplift and adjusted significance.
Use the guide alongside the working tool.
Open A/B Test Analyzer →Explicit working sample
variant,visitors,conversions
Control,1000,100
Variant A,1000,145
Variant B,1000,110Compare conversion rates with intervals, uplift and adjusted significance. Binary conversions only: one independent outcome per visitor. Uses a two-sided pooled two-proportion z-test where expected successes and failures are at least five per arm, Wilson intervals, and Holm adjustment for multiple comparisons against one control. Small samples receive intervals but no z-test conclusion. Fixed-horizon assumptions exclude repeated peeking, selection bias and non-random allocation.
Prepare the input
Compare conversion rates with intervals, uplift and adjusted significance.
CSV, TSV and arrays of scalar JSON objects are supported. Identifiers stay text. Empty cells are missing by default; add special missing tokens only if their meaning is certain. Use the sample to inspect the exact workflow.
Review the method
Binary conversions only: one independent outcome per visitor. Uses a two-sided pooled two-proportion z-test where expected successes and failures are at least five per arm, Wilson intervals, and Holm adjustment for multiple comparisons against one control. Small samples receive intervals but no z-test conclusion. Fixed-horizon assumptions exclude repeated peeking, selection bias and non-random allocation.
Keep the useful output
Review the summary and result records. Transformation tools retain separate change, rejected-record or diagnostics datasets where relevant. Choose the dataset before exporting; a report and a cleaned dataset serve different purposes.
CSV exports protect formula-like text. JSON keeps data portable without making an Excel workbook. Reports and editable backups may contain private source values; download only what you intend to share. No automatic account storage or server processing is used.
Ready to apply this workflow?
Try A/B Test Analyzer →Explore a related workflow
- Cohort Retention Analyzer: methods and data limits
Measure return activity by first-observed weekly or monthly cohorts.
- SQL Data Explorer: methods and data limits
Query local records with joins, CTEs and window functions.
- Parquet Viewer & Converter: methods and data limits
Inspect local Parquet metadata and export selected records.
- SQLite Database Explorer: methods and data limits
Explore tables, indexes and foreign keys in a local database.
Keep your original files and review the result. Found unclear instructions? Contact Team Edtoolkits.