Test & Learn Community

Now officially a nonprofit!

(effective 14 July 2023)

Sign the Code of Conduct to Join (FREE)

Thanks to our sponsors
GrowthBook logo
Ask-Y logo

Coming Soon

TLC: Statistical Inference for the ill-informed with Ellie Hughes

Hi TLCers!

I'm so excited to welcome Ellie Hughes of Eclipse to the TLC stage!! Ellie was kind enough to adapt a workshop she had for the TLC audience after a discussion in the TLC Slack gave us the idea. It's been a long time in planning, and I can't wait for y'all to join me in welcoming her.

Description
Who Is This Talk For? 
This talk is designed for anyone who has a general understanding that statistics is important but feels unsure about the complexities of statistical methods. It is for those who wonder: 

  • What is a school of statistical inference? 

  • What is a statistical method, and how do you decide which one to use? 

If you’ve ever felt embarrassed to ask whether you should use one method over another, this talk is for you. 

What Will Be Covered? 

Revisiting Statistical Basics 
We will start by covering a few statistical basics. While this talk goes slightly beyond the fundamentals of statistics, it will still provide a solid foundation for understanding more advanced concepts. 

Analyzing A/B Tests 
We will explore how to analyze A/B tests using two different approaches: 

  • Frequentist Methods: How A/B tests are typically analyzed under this school of inference. 

  • Bayesian Methods: How the same tests are approached differently using Bayesian inference. 

Comparing Statistical Methods 
We will also compare these methods to other approaches, such as: 

  • Least Likelihood

  • Regressions 

  • Parametric vs non-parametric tests by school of inference

These methods involve thinking about problems in a different way, but they are equally valid and useful. 

Why Is This Important? 
The goal is to help you understand the statistical options available to you. By considering these options, you can ultimately choose the simplest method that suits your specific use case. This approach ensures that your analysis is both effective and appropriate for your needs.

So join us, and join the conversation, on October 17th
9 AM Pacific | 10 AM Mountain | 11 AM Central | 12 Noon Eastern | 5PM London

*Zoom details will be shared on the TLC Slack community on the day of the event!

You can also now subscribe directly to the event calendar to the left.

TLC: Ethical Experimentation with Namrata Agarwal

Hi TLCers!

I'm super jazzed to welcome to the stage a first-time speaker and 2023 Experimentation Culture Awards Team winner, Namrata Agarwal! Namrata is going to share with us her talk about a truly important subject - experimentation and the ethical implications of what we're doing. We're talking about ethics, inclusivity, and humility. I'm so proud to have her here. So please join me in a huge welcome!

Description:  Ethical experimentation isn’t about running more A/B tests or chasing quick wins. It’s about humility, curiosity, and respect for the people who use our products. Let’s move beyond silos and solutions in search of a problem. Let’s build a culture where experimentation is thoughtful, inclusive, and-above all-ethical.

So join the conversation November 14!
8 AM Pacific | 9 AM Mountain | 10 AM Central | 11 AM Eastern | 5 PM CET

*Zoom details will be shared on the TLC Slack community on the day of the event!

You can also now subscribe directly to the event calendar to the left.