The Good Experimental Design Workshop
with Erin Weigel & Lucas Bernardi
About This Online Course
This workshop is designed for any curious experimenter who's kinda scared of math but wants to...
Gain confidence in the language and concepts used within experimentation, and
Level-up experimental design to collect reliable A/B testing data.
So, if you LOVE experimenting, BUT you're intimidated by p-values and confused by type I and type II errors—this is for you.
What you’ll learn
Most people learn experimentation concepts in a piecemeal way.
That means that the "big picture" of how the concepts within experimentation fit together is often fuzzy.
In this workshop, Erin Weigel (Principal Designer) and Lucas Bernardi (Principal Data Scientist) pull all the experimental design concepts together, cover them one-by-one (with pictures!), and show you clearly how they all fit together.
Once you have the big picture, they'll walk you through the Good Experimental Design Toolkit so you can put it into practice.
The Good Experimental Design Toolkit walks you through the logic and process of designing good experiments.
The Good Experimental Design toolkit helps you and your team design good experiments. It is a series of step-by-step templates to help you and your team structure your thought process to design effective experiments.
How this course is different
Erin and Lucas use plain language, clear examples, and facilitate hands-on exercises to share not only the theory behind experimentation, but also practical tips to help you in your day job. You’ll also get plenty of time to ask questions in a safe environment to demystify intimidating terminology.
Between Erin’s enthusiasm for experimentation and Lucas’s data science expertise—you’ll have a great time—and learn a LOT, too!
What this workshop covers
In this workshop you will...
Learn a little science history to give you context on the origins of good experimental design
Gain confidence in statistics and understand its confusing terminology (p-values, confidence intervals, alpha and beta, error types, sampling distributions, sample ratio mismatches, etc.)
Identify good experimental design through analyzing and critiquing experiment data and documentation
Practice designing experiments that are high-quality and will give you good data
Leave with a toolkit to make designing good experiments easy as pie (or cake, if that’s your thing)
Price & schedule
This course costs $1,000 per person (or $1,800 for two—come with a friend or coworker!)*+
Twelve students maximum per cohort. Two spots already taken!
+The TLC provides scholarships of up to $500 for this course. Please reach out to Kelly to apply. Please include in your email the amount you are requesting.
*$10 reserves your spot. The remaining balance will be invoiced once your cohort is scheduled.
The dates & times
Classes will be held Mondays for four consecutive weeks between Mon, Jan 27, 2025–Mon, Feb 17, 2025 from 5pm–7pm CET.
Classes run for two hours with a short break between each hour. Here is when you can expect the course to run in different timezones:
5pm-7pm Central European Time (17:00-19:00)
11am-1pm Eastern (11:00-13:00)
10am-12pm Central (10:00-12:00)
9am-11am Mountain (9:00-11:00)
8am-10:00am Pacific (8:00-10:00)
Classes are fully remote and will be held on these days:
Monday, January 27, 2025
Monday, February 3, 2025
Monday February 10, 2025
Monday February 17, 2025
About your instructors
Erin Weigel is a Principal Designer and author of the book, “Design for Impact: Your Guide to Designing Effective Product Experiments.” She has designed, developed, and analyzed thousands of experiments during her more than 15-year career.
From email marketing design and development, through to experimenting holistically across mobile app UI—Erin has deep knowledge of all the ways things can go wrong. (In other words, if there was a mistake that could be made, Erin made it. And now she can tell you about it, so you can avoid them!)
Though she stopped taking math classes when she was 15, she had the opportunity to learn a lot of the confusing technical stuff behind experimentation from these world’s leading experts:
Lucas Bernardi, her co-facilitator,
Lukas Vermeer, experimentation consultant, and
Jonas Alves, CEO and co-founder of ABsmartly (AB testing tool)
Erin remembers the challenge of learning this stuff. But she knows enough now to be able to simplify tough concepts into plain language and fun pictures alongside her co-facilitator, Lucas. Her approach makes learning more intuitive and way more fun than a university-type lecture.
Lucas Bernardi is a Principal Data Scientist and scientific reviewer for Erin’s book “Design for Impact.” He’s worked in big tech for 15 years and has run and analyzed tons of experiments. He loves all things science and has a total knack for explaining hard concepts with stories and metaphors. He’s super laid back, very patient, and he takes a practical approach to experimentation because he knows that the theory is only useful when it’s applied—and gives results.
Check out “Design for Impact”
This course is based on content from “Design for Impact: Your Guide to Designing Effective Product Experiments.” The book is written by Erin Weigel, and it was scientifically reviewed by Lucas Bernardi.
Buy a copy of “Design for Impact” to prime yourself for the course, here’s how:
If you live in the European Union, buy it directly at ErinDoesThings.com.
If you live anywhere else in the world, buy it at RosenfeldMedia.com.
You can also get it on Amazon or other major online booksellers.