Skip to main content
AB Testing

AB Testing

By AB Testing
Alan and Brent talk about Modern Testing (which isn't all that modern, and not really about testing) - including Agile, Lean, Delivery, DevOps, Data Science, Leadership, and more. Between them, Alan and Brent have nearly 60 years of software experience and are here to tell stories and talk about what they're seeing in the world of software.


Intro / Outro music on the AB Testing podcast is The One by Rivet. License: CC BY

Intro / Outro music on ABT343 is from filmmusic.io
“Werq” by Kevin MacLeod (https://incompetech.com)
License: CC BY (http://creativecommons.org/licenses/by/4.0/)

Listen on
Where to listen
Apple Podcasts Logo

Apple Podcasts

Breaker Logo

Breaker

Google Podcasts Logo

Google Podcasts

Pocket Casts Logo

Pocket Casts

RadioPublic Logo

RadioPublic

Spotify Logo

Spotify

Episode 134: Easier, Faster, Safer
It's a bit of a meandering discussion this time, but we dance around the role of teams that support other teams success. Here's the blog post link Brent refers to in the podcast - Test Doesn't Understand the Customer
49:19
February 22, 2021
Episode 133: Test Ownership and Test Automation
We reflect a bit on Alan's recent article (inspired by episode 132), and then talk quite a bit about the correlation of test automation ownership and quality. We hope you enjoy the show.
48:35
February 1, 2021
AB Testing - Episode 132: Mindsets and Metrics
It's our first episode of 2021 - where we talk (a little) about the US political situation, then discuss mindsets and skillsets - and then wrap things up with a discussion on estimation metrics.
52:43
January 11, 2021
AB Testing – Episode 131: The 2020 Year End Extravaganza
This is our last recording of 2020, so we reflect a little on 2020 and look forward to 2021.
47:08
December 7, 2020
AB Testing – Episode 130: The Pre-Election Episode
We talk a bit about the upcoming U.S. Election, discuss ideal team size, and then workshop some ideas on what “advanced” training for Modern Testing may look like.
52:39
November 2, 2020
AB Testing – Episode 129: Alan’s Journey to Modern Testing
This time it’s the story of Alan – from music teacher to bicycle messenger to modern testing (and just a few steps in between). It’s another view into the origins of modern testing.
50:55
October 19, 2020
AB Testing – Episode 128: Brent’s Path to Modern Testing
It’s origin story time. We talk about the early days of Brent’s testing career and how he found his way into the thing we now call Modern Testing.
52:15
September 21, 2020
AB Testing – Episode 127: Brent’s Hand & Alan’s Org
Apologies for the audio issues – Brent was having technical challenges. We cover stuff related to Alan’s growing team (and responsibilities) at Unity – plus the usual assortment of tangents.
54:04
September 8, 2020
AB Testing – Episode 126: Azure Powered
We talk about what’s going on with Alan’s expanded role at Unity and answer (sort of) a mailbag question about bottlenecks in delivering mobile apps.
54:55
August 17, 2020
ABT 343 – Andreas Worm
This time, Andreas Worm – aka @globalworming in our Slack group joins me for conversations, mostly about his experiences with scrum.
24:22
August 10, 2020
ABT 343 – Danny Faught
My guest for the ABT 343 is Danny Faught. We talk about his move out of being a dedicated tester, and well as the biography he’s putting together. Find Danny on twitter and read his blog.
32:07
August 3, 2020
AB Testing – Episode 125: P* Management and ATAOSQ
Just Brent and Alan this week. We talk about how Program Management can help with Modern Testing and Accelerating the Achievement of Shippable Quality… …but mostly Alan tries to explain to Brent that Product Management is different than Program Management, no matter what titles Microsoft use. Worth reading on the topic: https://leanpub.com/agileprogrammanagement
48:39
July 27, 2020
AB Testing – Episode 124: Learning with Maaret
Brent and Alan are joined by Maaret Pyhäjärvi, who talks with us about her role, the role of testing in general, mob programming, and a whole lot of other topics. I hope this was the beginning of a longer conversation, and we hope to have Maaret as a guest again soon. Maaret’s blogMaaret’s book on […]
51:31
July 13, 2020
AB Testing – Episode 123: Sue Loh’s Evil Plan to Save the World
Sue Loh (@suedeyloh on twitter). Sue has a lengthy history of finding and fixing nasty performance issues across a lot of different operating systems at Microsoft, but we spend most of our time talking about her Evil Plan To Save The World Get a copy of Sue’s excellent book, Raven, today
44:43
June 29, 2020
AB Testing – Episode 122: Julian Bucknall and TestCafe
We are joined by the CTO of Devexpress to talk about TestCafe.
53:30
June 8, 2020
AB Testing – Episode 121: Peter Senge is Old
We talk a bit about Covid (again), touch on a few random subjects, and then find time to answer a few mailbag questions. We also now have an AB Testing Podcast instagram.
50:53
May 18, 2020
AB Testing – Episode 120: David Bishop on Metagility
For this episode, we are joined by David Bishop – the author of a new book called Metagility. There’s a lot of good stuff here, and we think you’ll find it interesting. Links for more info: Book information – https://www.jrosspub.com/metagility.html David’s company – https://agile-worx.com Current course schedule – https://www.metagility.technology
49:34
May 4, 2020
ABT 343 – Melissa Eaden
Melissa Eaden is in the hot seat this week to talk about management, leadership, modern testing, and more. Melissa’s blog: https://testingandmoviesandstuff.blogspot.com/ Melissa on Twitter: @melthetester
32:41
April 23, 2020
AB Testing – Episode 119: Retrospectives
We, of course, talk about working through Covid-19, but we spend most of our time talking about retrospectives.
47:11
April 20, 2020
ABT 343 – Yuliya Bagriy (aviskase)
Yuliya Bagriy (known across the internet as aviskase) is my guest this time. We talk about her path into testing, a bit about her new role, and the origin of the alias, ‘aviskase’ – which includes a tangent on how she broke Postman.
32:20
April 9, 2020
AB Testing – Episode 118: Covid continues; and Velocity
We talk about Covid (because every meeting does these days). And we also (sort of?) talk about velocity.
53:55
April 6, 2020
ABT 343 – Chris Kenst
I’m joined by Chris Kenst, who talks about his path into testing, his job as an automation engineer (which he convinces me not to hate), and his work with AST. He also mentions these links. His job – https://bloomnation.com AST – https://associationforsoftwaretesting.org Blog – https://www.kenst.com List of test conferences – https://testingconferences.org Testing education resources – […]
40:47
March 31, 2020
ABT 343 – Melissa Pohlman
343 is back with Melissa Pohlman, who has thoughts for testers, advice for managers, and stories about a whole lot more.
30:18
March 23, 2020
AB Testing – Episode 117: The Covid-19 WFH Show
We talk quite a bit about working from home, and a bit about test coaching / consulting in the Modern Testing world. We hope everyone is staying healthy and sane out there.
53:19
March 17, 2020
AB Testing – Episode 116: What’s the Deal with ISTQB?
We have an in-depth discussion on the recently published Vision on the Future of Software Testing from ISTQB
51:21
March 2, 2020
AB Testing – Episode 115: Gates and Balmer and Satya (oh my)
This time, we reflect on the Gates, Balmer, and Satya eras at Microsoft.
44:29
February 17, 2020
ABT 343 – Conor Fitzgerald: The Sequel
Conor is back for more questions on Modern Testing. As with last time, you can follow him on Twitter (@conorfi) and read his blog here. Intro Music from https://filmmusic.io “Werq” by Kevin MacLeod (https://incompetech.com) License: CC BY (http://creativecommons.org/licenses/by/4.0/)
27:51
January 22, 2020
AB Testing – Episode 114: Random Reflections and Reading
Happy New Year! This week, we react to a 15 -year-old paper, and then somehow segue into talking about a few other papers. Papers mentioned: The Ongoing Revolution in Software Testing By Cem Kaner State of DevOps 2019 An Analysis of the Effect of Code Ownership on Software Quality across Windows, Eclipse, and Firefox by Nachi Nagappan
59:05
January 14, 2020
ABT 343 – Conor Fitzgerald
In this 343, Conor Fitzgerald and I talk about his experiences in testing, his experiences in Modern Testing, and a whole lot more. More info: Follow Conor on twitter: @conorfi Read his blog Also worth linking is Elisabeth Hendrickson’s Explore It!
35:26
January 6, 2020
ABT 343 – Perze Ababa
In this 343, I’m joined by one of the long-time listeners and supporters of the AB Testing Podcast, the one and only, Perze Ababa. We talk (mostly) about leading a quality culture, but as you’d expect, we take a few tangents along the way. Perze is @perze on twitter – follow him!
42:16
December 29, 2019
AB Testing – Episode 113: The 2019 Year End Extravaganza
We reflect on our December 2018 predictions, look back on the wonderful year of 2019, and talk a bit about what we expect in 2020. Happy Holidays from the two of us to the three of you.
54:30
December 17, 2019
AB Testing – Episode 112: The Penultimate Potpourri
Lots of topics this time, including CI/CD, UI automation, and ABT ulterior motives. Notes (more to be added later): Rockstar language Advent of Code
44:47
December 11, 2019
ABT 343 – Maciej Wyrodek
Maciej Wyrodek joins the 343 podcast to talk about his experiences with modern testing, The Unicorn Project, and various rants about the state of software testing. Follow Maciej On twitter – @maciejwyrodek His blog – The Broken Test Also mentioned: The Modern Testing Principles mindmap Polish article on the state of testing
28:02
December 2, 2019
ABT 343 – Areti Panou
I am joined this time by Areti Panou. Listen in to hear more about her changing role, and her experience with modern testing. Areti’s blog is unremarkabletester.com, and you can folllow her on twitter – @unremarkableqa
28:13
November 25, 2019
AB Testing – Episode 111: Oredev, DevOps, and Stuff
We talk a bit about Oredev, some more about devops, controversies in the principles, and a bit more about Alan’s role at Unity.
54:59
November 18, 2019
ABT 343 – Dave Westveld
Our guest is Dave Westerveld. We talk a bit about accessibility, challenges in testing LMS software, and a lot of “modern” topics. Follow him on twitter @offbeattesting, and his blog at https://offbeattesting.com/
31:29
November 13, 2019
ABT 343 – Andrew Morton
Our first real episode is a quick chat with Andrew Morton. Andrew is the Dev Boss at Ministry of Testing, and can be found at @testingchef on Twitter
18:48
October 31, 2019
AB Testing – Episode 110: PM, PM, and MT
We spend most of this podcast trying to understand each other while we wind through conversations on Product Management, Project Management, Program Management and how they all fit into quality.
52:43
October 29, 2019
AB Testing – Episode 109: The MT Guide to Promotions
Some discussion (and rants) on career maps (aka career ladders, levels, etc.) – and our experiences in how to make these fail spectacularly (and sometimes work).
51:35
October 15, 2019
AB Testing – Episode 108: Lack of Testers vs. Lack of Testing
it’s a mailbag show, where we talk about whether or not bugs in Windows 10 are due to a lack of a test team, and how you can apply MT principles if you’re a consultant asked to write automation. Once again, the audio isn’t awesome, but quality debugging continues.
55:29
October 1, 2019
AB Testing – Episode 107: A Plethora of Principles
Good news: We have a new episode!Bad News: I am doomed to never having another podcast without audio issues. My mic cable must have been lying across the speakerphone in the conference room, as it was picking up a massive amount of static. I was able to remove the static (you’ll thank me), but removing […]
47:37
September 16, 2019
AB Testing – Episode 106: Weapons of Math Destruction
Steve Rowe is back (for the third time!) on AB Testing to take part in a discussion on ethics in data science. Hope you enjoy.
49:54
August 12, 2019
AB Testing – Episode 105: A World of Modern Testing
Heads up – our technical producer (me) messed up levels and microphone choice and we ended up with a little bit of bleed between microphones that ends up not meeting our normally high quality standards. The next one will be better. For content, we talk a lot about what we’re seeing in the industry that […]
46:53
July 31, 2019
AB Testing – Episode 104: Leading Quality (with Ron Cummings-John)
We are joined by the author of Leading Quality, Ron Cummings-John to talk about his upcoming book. More info at https://leadingqualitybook.com
45:15
July 1, 2019
AB Testing – Episode 103: The Croissants are Selenium (with Jason Huggins)
We are joined by the inventor of Selenium, Jason Huggins. Listen in for stories about the early days of Selenium, Jason’s thoughts on our UI rants, and much much more. Be sure to check out Jason’s latest venture – Tapster
56:42
June 3, 2019
AB Testing – Episode 102: Modern Testing takes on UI Automation
Alan recently took some heat on Twitter for disliking Selenium – or more accurately, how it was being used. This episode is a discussion and expansion of why Alan and Brent both have strong feelings about the industry infatuation with UI testing.
48:56
May 20, 2019
AB Testing – Episode 101: AB…not testing?
We realize during the intro, that this is the first time we’ve recorded an AB Testing podcast when neither Alan nor Brent are in a dedicated testing / QA role. What does that mean for Modern Testing? Turns out – not that much. Listen as we discuss.
43:41
May 6, 2019
AB Testing – Episode 100: The AB Testing Fanfest
Thanks to everyone who helped get us to this milestone episode. For episode 100, we share cast-time with all three of our listeners – who may or may not have been paid for their kind words.
54:53
April 15, 2019
AB Testing – Episode 99: Post-Modern Alan
This episode brought to you by Practitest – https://www.practitest.com. We spend some time preparing for episode 100, and talk just a bit more about what Alan may do next at Unity.
39:43
April 1, 2019
AB Testing – Episode 98: Stuff about Alan and a Mailbag Question
We talk very abstractly about Alan’s new role, and dive into a mailbag question on the role of leadership in a quality culture. This episode is brought to you by Practitest – check them out at https://www.practitest.com
47:59
March 12, 2019
AB Testing – Episode 97: Questions About Developers and Tests
An all mailbag show where we talk about skills needed by testers today, how to get developers to write tests, and hiring. Register for Brent’s AST webinar on Thursday – https://www.associationforsoftwaretesting.org/2019/01/23/webinar-building-a-data-centric-modern-quality-culture-with-brent-jensen/
50:44
February 18, 2019
AB Testing – Episode 96: Principle #8???
Happy New Year everyone – amongst catching up, we spend most of the time discussing and debating a potential eighth Modern Testing Principle.
44:41
January 15, 2019
AB Testing – Episode 95: The 2018 Reflection / Prediction Show
Happy Holidays to each and everyone of our three listeners. We review and reflect on 2018, and talk about some things we think may happen in 2019. Listen all the way to the end for a cliffhanger from Brent. Thanks again for listening – in 2019, we will hit episode 100, our 5 year podacting […]
50:11
December 25, 2018
AB Testing – Episode 94: Modern Testing meets Context-Driven Testing
It’s the penultimate show of 2018, with a lot of (hopefully interesting) preamble on this one, but we spend a chunk of time reviewing the Context-Driven Testing Principles and how they relate to the Modern Testing Principles.
44:16
December 3, 2018
AB Testing – Episode 93: The Quality Culture Transition Guide
We eventually talk about a model Alan built to help a team discover where they need to grow in order to build a quality culture or move towards modern testing (they’re kind of the same thing). Some rants and ramblings also included.
53:26
November 12, 2018
AB Testing – Episode 92: Customers, Bugs, and Triangles
We almost (but not quite) blast through the banter at the beginning, but eventually get a chance to talk a bit more about interpreting Principle #5, and dive into a James Bach talk on the Test Automation Pyramid.
43:09
October 22, 2018
AB Testing – Episode 91: Stories and Models and Things
We answer a mailbag question,  begin to dive into what attributes make up a quality culture, and talk about other stuff. And we have a new intro.
52:32
October 8, 2018
AB Testing – Episode 90: A Lot About Nothing
It’s almost an all tangent episode, but we do (eventually) get a chance to discuss how ML and AI are changing testing and quality, and we pay our respects to the great Jerry Weinberg.
45:30
September 24, 2018
AB Testing – Episode 89: Modern Testing Mailbag
All mailbag episode as we answer questions about combined engineering teams, life after Modern Testing, and early project “data” samples
46:32
September 10, 2018
AB Testing – Episode 88: Testing Isn’t Dead (Testers, OTOH…)
It’s the last of our deep-dive series on Modern Testing Principles. This time, we discuss the (sometimes controversial) principle number 7: We expand testing abilities and knowhow across the team; understanding that this may reduce (or eliminate) the need for a dedicated testing specialist. Not too many tangents this time. Next time, we’ll get caught up […]
46:47
August 20, 2018
AB Testing – Episode 87: The One About Data
On to the next principle in our deep dive series. Principle Number 6 says: We use data extensively to deeply understand customer usage and then close the gaps between product hypotheses and business impact. Note that episode 82 makes a nice listening companion.
55:25
August 6, 2018
AB Testing – Episode 86: Not the Customer’s Champion
We’re back to discuss another of the modern testing principles. We believe that the customer is the only one capable to judge and evaluate the quality of our product Discussions include a brief discussion of the Kin phone from Microsoft. Finally – if you missed it, the Modern Testing AMA recording is here.
44:00
July 24, 2018
AB Testing – Episode 85: The Community Principle
Our dive into the Modern Testing Principles continues with a dive into principle number four: We care deeply about the quality culture of our team, and we coach, lead, and nurture the team towards a more mature quality culture.  
53:26
July 9, 2018
AB Testing – Episode 84: Stories about Changes and Nets
On to Principle number 3 (full list at moderntesting.org). We are a force for continuous improvement, helping the team adapt and optimize in order to succeed, rather than providing a safety net to catch failures. As promised in the show, there will be an AMA on Modern Testing hosted by Ministry of Test on July […]
56:45
June 25, 2018
AB Testing – Episode 83: Accelerating the Team
We’re back to the MT Principle Deep-Dives (which may just be medium dives). Principle #2 says: We accelerate the team, and use models like Lean Thinking and the Theory of Constraints to help identify, prioritize and mitigate bottlenecks from the system. We talk about that – but of course, there are a few tangents we […]
48:02
June 5, 2018
AB Testing – Episode 82: Brent Talks to Alan About Data
We are already taking an interlude from principle deep-dives to reflect a bit on the episode 81 feedback, and for Brent and Alan to have short (but in depth) discussion on how to get started creating actionable metrics. We’ll be back to Modern Testing principles in episode 83.
45:20
May 22, 2018
AB Testing – Episode 81: Business Rulz!
It’s time to deep dive into the Modern Testing Principles with #1 – Our priority is improving the business. We also dive into some experiences and observations from Alan’s recent trip to STAR East.
50:40
May 7, 2018
AB Testing – Episode 80: The Mailbag returns: Modern Testing questions
It’s a mostly mailbag show, and we talk about the role of a modern testers as a role that transitions an organization to following the modern testing principles.
50:25
April 23, 2018
AB Testing – Episode 79: The Modern Tester Goes to Testbash
We talk quite a bit about testbash, Modern Testing, and give deeper answers to a few of the questions that came up in around the first public appearance of the Modern Testing Principles.
51:09
March 26, 2018
AB Testing – Episode 78: Digging in on Modern Testing Principles
We don’t reiterate the Principles directly (see the Episode 77 show notes for that), we talk a lot about how we are adapting the principles slightly based on feedback and discussions with the three – and how much better the principles are for the effort. We also discover that both Brent and Alan love to cook. […]
50:47
March 12, 2018
AB Testing – Episode 77: The Conception of the Modern Testing Principles
We discuss, vet, and rewrite (and not for the last time), the Modern Testing Principles. These are a work in progress, but we’re happy to share the current final form. Listen to the podcast to hear these developed in real time. The customer is the only one suitable to judge and evaluate the quality of […]
51:27
March 5, 2018
AB Testing – Episode 76: Communing with Testers
More on community, a few tangents, and a few strong opinions.   Mentioned in this episode: Influencer: The New Science of Leading Change Situational Leadership – Training, etc can be found here
49:41
February 19, 2018
AB Testing – Episode 75: From Spider to Starfish
We talk about how testers (and test specialists) can use the power of community to discover what they don’t know they don’t know. And other stuff.
41:03
February 13, 2018
AB Testing – Episode 74: Where in the World is the Weasel?
First show of 2018, with a variety of topics that are all mostly about Modern Testing. Items of note include the State of Testing survey, podcast plans for 2018, Alan’s presentation schedule, and the usual amount of tangents.   Links: AST Webinar (Alan presenting) State of Testing Survey
48:35
January 29, 2018
AB Testing – Episode 73: 2017 Year in review and Predictions episode
It’s the 2017 year end extravaganza with discussions about 2017, thoughts and predictions about 2018, and more…including… The AB Testing Merchandise shop – http://cafepress.com/abtesting And, sign up for Audible with AB Testing http://audibletrial.com/abtesting   We’ll be back in 2018.
50:27
December 18, 2017
AB Testing – Episode 72
It’s the penultimate AB show of 2017. More discussions about modern testing, a bit of a preview of what’s coming up in episode 73, the role of a modern tester in code craftsmanship, and a bit on this shift-left thing.
51:55
December 5, 2017
AB Testing – Episode 71
In this eclectic episode, we discuss college savings plans, personal finance (wtf?), definitions of “Modern Testing”, and recap the Unity Services Test Summit (where Brent presented on moving to a data-centric culture). Enjoy.
43:55
November 21, 2017
AB Testing – Episode 70
Steve Rowe is back for another visit, and he shares some of his experiences from STAR Canada, discusses logical fallacies, and we all chime in on the transition from traditional to modern testing.
49:24
November 6, 2017
AB Testing – Episode 69
We had a brief break in recording, but we’re back with another fun-filled fifty minutes where we take mailbag questions on the pros and cons of ISTQB certification, the impact of easy-to-create GUI tests on the testing pyramid, and whether or not you really need a data scientist.
49:13
October 16, 2017
AB Testing – Episode 68
We spend a chunk of time talking about a report (The State of Functional Testing), and how it aligns with modern testing. We answer a #mailbag question elaborating on the role of a modern tester, and we get to hear Brent functioning on just a few hours of sleep.
49:02
September 18, 2017
AB Testing – Episode 67: The Traditional vs. Modern Test Manager Debate
For this episode, we shoved Brent into a time machine and asked 1990s “Traditional Test Manager” Brent to have a conversation with “Modern Testing Manager” Alan. The usual arguments and antics follow.
47:02
September 7, 2017
AB Testing – Episode 66
A bit of a follow up episode with more management advice. We talk about how to give feedback to our employees and about frameworks and approaches we like for giving that feedback.   This episode brought to you by STAR Canada.  If you are thinking about attending, STARCANADA is offering 20% off your conference fees […]
01:03:43
August 21, 2017
AB Testing – Episode 65
It’s the AB Testing Management episode. We reflect a bit on our growth as managers and share some of the tools and philosophies that (we hope) allow us to succeed. Some of the books mentioned include (also note the link on the right for a free month of Audible): The Leaders Guide to Radical Management […]
53:44
August 15, 2017
AB Testing – Episode 64
We talk about Agile Testing (both the concept and the book), and how it relates to the “Modern Testing” we’ve talked about before. Also – there’s a mailbag question on Multi Armed Bandit Testing. This episode brought to you by the folks at Techwell. Attend Agile Dev East, the premier agile event covering the latest […]
50:29
August 8, 2017
AB Testing – Episode 63
More talk about data, CIRA (collect-inform-recommend-act), and Brent gives Alan free advice on maturing a data aware organization. We mention the great Douglas Hubbard book – How To Measure Anything This AB Testing brought to you by Kobiton Test your mobile app on real cloud based devices today! Kobiton is the complete mobile device cloud […]
48:11
July 18, 2017
AB Testing – Episode 62
It’s an all mailbag show, with questions (and answers) about Model-Based testing; if testers are being (or will be) phased out – or if the role of the tester is simply evolving and expanding (and if the expanded role needs a new name); and some expansion on the Collect-Inform-Recommend-Act model. This episode sponsored by the […]
57:28
July 10, 2017
AB Testing – Episode 61: INTP – Intermittently Normal Tangential Podcast
It had to happen – it’s an all-tangent show! But, somehow we manage to cover a lot about technical testing, data science, tester mindset and more. Alan mentions a lot of books on this episode – here’s the list with amazon links. Steal like an artist Everybody Lies Wonderland What every BODY is saying And […]
52:50
June 26, 2017
AB Testing – Episode 60: #ATAOSQ – Information providers no more
Here at AB Testing, we like this episode a lot. Give it a listen and let us know what you think. More on modern testing, and we break down “accelerating the achievement of shippable quality” in the mailbag segment.  
01:00:35
June 12, 2017
AB Testing – Episode 59
We are back with Rants, Rages, and Regurgitated information from the world of software engineering, and software quality. Topics include just a bit of chat about checking and testing, and then a deeper dive into the topic of “Modern Testing”. This episode brought to our listeners by Kobiton. Test your mobile app on real devices […]
41:14
May 29, 2017
AB Testing – Episode 58
Topics this time include a brief recap of episode 57, discussion on viewing a test organization as a community, and a mailbag question on dealing with budgets.
54:24
May 7, 2017
AB Testing – Episode 57: Hans Buwalda explains action-based testing
This time on AB Testing, we share the microphone with automation expert, Hans Buwalda. We talk with Hans a lot about his views on test design and test automation, including action-based testing (one of the other AB testing types), as well as his upcoming talks at STAR conferences. This episode brought to our listeners by Kobiton. […]
44:00
May 1, 2017
AB Testing – Episode 56
Took a while, but we’re back and ranting away. This time, we talk about the role of Test / Quality as, Accelerating the achievement of shippable quality, and, in a newly named segment called, “Alan talks about working at Unity”, Alan aswers a mailbag question about his approach to change working at Unity.
55:13
April 3, 2017
AB Testing – Episode 55
It’s the double-nickel episode of AB Testing. Included in today’s ramblings are: Alan and Brent talk about graduate school, and learning in general, as well as our thoughts on Dr. Seuss’s greatest works Our sponsor, Techwell, is offering a $250 discount on upcoming software training classes in Boston and Chicago using the promo code 17ABW – […]
45:35
March 6, 2017
AB Testing – Episode 54
First ever AB podcast with A&B working at two different companies. As expected, Alan talks about Unity the whole time.
45:16
February 21, 2017
AB Testing – Episode 53
Alan’s last day at Microsoft, Tequila, and a mailbag. Oh yeah – and this show sponsored by Techwell. Use the promo code ABTesting to get $200 off of you STAR East registration.
49:17
January 26, 2017
AB Testing – Episode 52
Some bad recording (but only at the beginning this time), and some big news. Listen and find out the latest on AB Testing.
53:35
January 19, 2017
AB Testing – Episode 51: 2016 Year in review and Predictions episode
It’s our 2016 end-of-year extravaganza – if extravaganza means Brent and Alan randomly talking about their favorite software moments of 2016. We also recorded our 2017 predictions…but audio went haywire, so we’ll have to wait for a re-hash of that topic in early 2017. Notes! Blogs: – http://andrewgelman.com/ – http://dataminingblog.com Blog Posts: – https://knowledgetester.org/2016/09/20/generalist-specialist-t-and-pi-shaped-testers/ – http://www.dataminingblog.com/the-5-most-common-data-relationships-shown-through-visualization/ […]
35:42
December 23, 2016
AB Testing – Episode 50
It’s the Big Five-Oh for Alan and Brent. For our golden anniversary, we talk about TLAs, PMs gone wild, the Concierge MVP, and Brent takes a scrum master quiz.
47:18
December 14, 2016
AB Testing – Episode 49
More about TestBash, and Alan (finally) gets into specifics on Microsoft Teams. And tangents….
43:07
November 21, 2016
AB Testing – Episode 48: Alan hosts the Three at Test Bash Philly
Live from Test Bash in Philadelphia, this is VAMP Testing with three of the three (Vernon Richards (@testerfromleic), Michael Richards (@saltygunner), and Perze Ababa (@perze)). We discuss sessions at TestBash along with the appropriate number of tangents.
26:09
November 18, 2016
AB Testing – Episode 47
This episode includes a discussion of Alan’s new car (along with ideas on learning and saving), and a long discussion on Alan’s long journey to continuous delivery. And a mailbag.
01:00:21
October 24, 2016
AB Testing – Episode 46: Steve Rowe discusses Data . . . and Stuff
In episode 46, we have our very first guest, as Steve Rowe joins us for a discussion on his 3 years in a data science role (plus the usual tangents and random bits of trivia)
58:13
September 28, 2016
AB Testing – Episode 45
Pretty much more stuff on what it takes to become data-centric. And weirdly, Alan gives Brent a hard time.
47:13
September 9, 2016
AB Testing – Episode 44
This episode is dedicated entirely to the topic of how to transition from data oblivious to a data-centric organization. Very little Alan yelling at Brent, but a whole lot of Brent preaching goodness about how to use data to advance product quality.
49:34
August 26, 2016
AB Testing – Episode 43
Hey – audio is much better this time. Episode 43 includes discussions of test generation tools, learning, and whether or not Microsoft is a good example of advancing engineering. Don’t forget – use the promo code ABTESTING when you register for StarWest to get a $200 discount (or go to http://well.tc/starwestab)
45:13
August 17, 2016
AB Testing – Episode 42
First off, the audio on this episode has a few issues – we’ve taken steps to improve that in the future. The content includes Alan being Angry, the concept of “Feature Jam”, discussion about CDT, and a bit about data driven engineering.    
38:29
July 25, 2016
AB Testing – Episode 41
Topics this time include Performance Reviews, Alan’s trip to the Better Software conference, the changing role of Program Management at Microsoft, and a shot out to the folks at The Testing Show.
48:52
June 20, 2016
AB Testing – Episode 40
It’s an(other) all mailbag show. And it’s episode 40. And it was recorded on National Donut Day – what else could you ask for?
48:29
June 7, 2016
AB Testing – Episode 39
Hey everyone… This time around, we talk a bit about Alan’s trip to Waterloo, and then we deep dive into Agile’s “longstanding and ongoing attack on the testing role” As you can expect, it’s a fun one.
49:50
May 20, 2016
AB Testing – Episode 38
An almost all-mailbag show, Alan and Brent discuss planning semesters vs. milestones, v-teams, and managing teams vs. managing features.
49:08
May 4, 2016
AB Testing – Episode 37
Live, on the air, we reply to a tweet that kicks off oneofthethree.slack.com. And then Brent (inspired by Patrick Prill  aka @testpappy) asks Alan to define Quality, Testing, Test Cases, Testers, Integration Testing, and a few other terms that are difficult to define for most of the three, including (especially?) Alan.
56:35
April 18, 2016
AB Testing – Episode 36
It’s been two years, and 36 episodes…of the same stuff. Yet people still listen. This episode includes some discussion of shipping every day (or at least more often than once a week), open space work areas, and what could be our own AB Testing record for tangents within a podcast!
01:01:37
April 10, 2016
AB Testing – Episode 35
We’re baaaaack. This episode covers the one time when Alan was a developer, Ryan Reynolds as Deadpool, balancing quality, collective ownership, and developer owned quality. All in less than an hour.
55:40
March 15, 2016
AB Testing – Episode 34
Another AB Testing podcast in the books (and on the web). This time, we discuss the nature of bugs, why we don’t want our testers back; and in the mailbag session, discuss our role in backlog grooming and planning.
01:00:33
February 12, 2016
AB Testing – Episode 33
Happy new year. This blab-fest covers Star Wars, Fallout 4, straw man arguments, even more on Combined (or Unified!) Engineering, and why smart people do stupid things!
51:12
January 12, 2016
AB Testing – Episode 32: 2015 Year in review and Predictions episode
It’s the 2015 recap show, where Brent and Alan reflect on 2015, and make some predictions for 2016…and somehow take nearly an hour to do so. Some links from the show Podcasts: This American Life – Episode 403: Nummi – http://www.thisamericanlife.org/radio-archives/episode/403/transcript Freakonomics Radio – http://freakonomics.com/radio/freakonomics-radio-podcast-archive/ Wait Wait Don’t Tell Me – http://www.npr.org/podcasts/344098539/wait-wait-don-t-tell-me Good Job Brain – http://www.goodjobbrain.com/ Total Soccer […]
55:38
December 18, 2015
AB Testing – Episode 31
This episode includes a quick rant on tecking vs. chesting (or something like that), moving from predictive to adaptive, and the mailbag is back with a discussion on combined engineering.
42:35
December 5, 2015
AB Testing – Episode 30
This episode is all about “stuff Alan and Brent did” – or at least it started that way until we start rambling. Quick recaps of the Strata conference, Eurostar, Redfin, and Riot all find their way into our discussion.
42:55
November 20, 2015
AB Testing – Episode 29: LIVE from the Redfin HQ
From the offices of Redfin in Seattle, Washington, Brent and Alan deliver the first ever AB Testing roadshow. Sound isn’t fantastic, and the content, as usual, isn’t very original, but I’m sure one of us said something that will raise your eyebrows. Thanks to Evan and everyone else at Redfin for hosting us, feeding us […]
01:19:29
November 10, 2015
AB Testing – Episode 28
Yet another installment of AB Testing (including what I think is a world record for AB Testing release velocity). This episode includes another rant from Alan about dumb things people do at Microsoft, a long tangent on Alan’s music background that has no relevance whatsoever, and some discussion on upcoming public appearances from Brent and […]
50:50
September 25, 2015
AB Testing – Episode 27
In their patented pattern of pure randomness, Alan and Brent talk about the context-driven school of testing, the video music awards, upcoming test conferences, and pointy-haired managers! Errata: Lessons learned…came out in 2001 (not 2003 as Alan guessed on the show). A link to Ioana’s awesome CAST talk is here
43:44
September 4, 2015
AB Testing – Episode 26
Recorded in downtown Bellevue, WA…Alan and Brent talk about a talk – and Alan asks Brent questions from a sample ISTQB test.
39:40
August 10, 2015
AB Testing – Episode 25
Discussions include Agile, Alan’s new job, developer testing, and we go to the mail bag (maaaiilll baaaaaag) for a quick discussion of Tension Metrics.
53:12
July 22, 2015
AB Testing – Episode 24
A trip report from STAR Canada; some discussion of whether or not test is dead (or if being dead is dead), and a trip into the mailbag to talk about monolithic test systems. And Alan fixed the bug that was hiding the media bar on the blog site.
52:27
June 30, 2015
AB Testing – Episode 23
It’s Alan’s 20-year anniversary at Microsoft…and he has a new job. We also talk preview Alan’s talk on A/B (with the slash) testing at Better Software, and attempt to get through some mailbag items without getting too distracted (we failed).
46:34
June 5, 2015
AB Testing – Episode 22
In this episode: Iterative is not Agile, Brent’s version of the penny game, and a short discussion of AB Testing vanity metrics. …and probably other stuff too.
43:02
May 18, 2015
AB Testing – Episode 21: Dysfunctional Central Organizations
Rants and soapboxes are back. This episode also includes a discussion of central organizations, why they fail, and how they can work. And other fun stuff too.
41:35
May 4, 2015
AB Testing – Episode 20
It’s our twentieth podcast, AND – it’s our one year anniversary show. We talk about logical fallacies, generalists, and a whole lot of other random topics.
48:10
April 9, 2015
AB Testing – Episode 19
In this episode, Alan and Brent talk about dashboards, scorecards, buzzwords, soapboxes, and Alan’s appearance on another podcast. Also included is yet another installment of silly things people do at work to incur the wrath of Alan.
51:18
March 24, 2015
AB Testing – Episode 18
Brent has a new job! We talk about what Brent does, discuss interviews, and what test specialists actually (may?) do. And other stuff. Here’s the link for the Data Science in the Cloud e-book mentioned in the podcast.
53:14
March 2, 2015
AB Testing – Episode 17
Eventually….Brent and Alan discuss their thoughts on the future of the Program Manager role at Microsoft. The journey there, as always, is interesting and perhaps even entertaining.
44:51
February 5, 2015
AB Testing – Episode 16
We’re back for our first episode of 2015…where we talk about almost nothing, but do manage to discuss management styles, holocracy, and what we did with our holiday break.
44:47
January 20, 2015
AB Testing – Episode 15
In our last podcast of Twenty-Fourteen, Brent and I talk about Generalizing Specialists, Specializing Generalists, and weird things Alan sees at Microsoft (and other random topics that pop up along the way).   Happy Holidays everyone
45:44
December 19, 2014
AB Testing – Episode 14
We’re back! Topics this week include: Heroes vs. Teamwork Not Invented Here Syndrome Bean Counters The Mailbag And the completely bizarre story of Brent’s first days at Microsoft
47:47
December 9, 2014
AB Testing – Episode 13
If only you could hear what we left on the editing room floor… Instead, Alan and Brent talk about GTAC, meetings, and bring back the mailbag.
43:20
November 13, 2014
AB Testing – Episode 12
This episode includes discussions on peer feedback, the “Skill and the Will”, Alan’s favorite author, Steven Johnson, Not-Invented-Here, and learning organizations.
44:25
October 27, 2014
AB Testing – Episode 11
Alan and Brent are back. In this episode, they discuss interviews, data driven engineering, knowledge sharing and the usual grab bag of tangents and random topics related to software and software quality.
45:15
October 14, 2014
AB Testing – Episode 10
After a long break, Brent and Alan are back with Episode 10. This week, A & B talk about what changed at Microsoft this summer, what they think is going to change next, and talk a bit about the latest IOS bug. Note: the audio is a little wonky this week. Long story, but it […]
41:21
September 26, 2014
AB Testing – Episode 9
Last episode of the summer! Alan talks about git, roles of testers, and we talk about what may (or will) change while Alan is taking a long, long break.
45:09
July 9, 2014
AB Testing – Episode 8
And…we’re back. this episode covers Brent’s IRRs, Agile Testing, and, as usual, a wide variety of tangents and rants.
42:50
July 9, 2014
AB Testing – Episode 7
In this “all-mailbag” episode, we talk more about change (specifically some changes in engineering approaches we see at Microsoft, including changes in the way we lead and manage people), and a variety of related (and not-so-related) rants. Enjoy.
52:02
June 16, 2014
AB Testing – Episode 6
Alan and Brent are back. This time they talk about work item tracking, QOS & QOE, the World of Warcraft guide to running v-teams, and Alan’s upcoming extended vacation.
29:17
June 3, 2014
AB Testing – Episode 5
Brent and Alan are  back! In this episode, they discuss Alan’s trip to STAR East, the perils of automation, some ideas on leadership, and how not to tell your team that you’re “Agile”.
44:34
May 19, 2014
AB Testing – Episode 4: Leading Change, Learning Organizations, and Test Zombies
In this episode, Brent and Alan discuss Alan’s upcoming trip to the STAR East test conference, and a bit about using Kanban for chores. And then comes a question / statement about estimation that’s worth every minute.
49:29
April 28, 2014
AB Testing – Episode 3: Dashboards, Documentation, and Dumb manifestos
In this installment, Alan and Brent talk about Alan’s trip to Florida, data driven engineering, and estimation. And Brent claims that he “hates the Agile Manifesto”.  
43:31
April 14, 2014
AB Testing – Episode 2: What AND Why
In this episode, Brent and Alan talk about change management and the difference between Predictive, Iterative, and Adaptive software development models. And Testing!
36:13
April 7, 2014
AB Testing – Episode 1: Introductions
Episode 1 – Two Software Testing veterans from Microsoft decide to start podcasting.
19:14
April 3, 2014