Alan and Brent talk about Modern Testing (which isn't all that modern, and not really about testing) - including Agile, Lean, Delivery, DevOps, Data Science, Leadership, and more. Between them, Alan and Brent have nearly 60 years of software experience and are here to tell stories and talk about what they're seeing in the world of software.
Intro / Outro music on the AB Testing podcast is The One by Rivet. License: CC BY
Intro / Outro music on ABT343 is fromfilmmusic.io “Werq” by Kevin MacLeod (https://incompetech.com) License: CC BY (http://creativecommons.org/licenses/by/4.0/)
We're joined by Nick and Todd from https://reflect.run to talk about the future of test automation (sort of) and developers creating UI automation. We loved having these folks on the show, and hope you enjoy the conversation.
We dive into our history of personality type tests. Starting with the classic MBTI, we move to Insights, Strengths Finders, and then Working Genius (we also briefly mention our Harry Potter houses).
This time we talk a bit about learning (including an upcoming webinar from alan - https://www.meetup.com/Pacific-NW-Software-Quality-Conference-PNSQC/events/276239634, and talk about quality vs. testing - which is just another framing of principle 5 of the modern testing principles.
We talk a bit about personality types (more on this in 136), touch on some thoughts on record & playback automation, and a few other tangential topics.
Books mentioned on this podcast include:
Accelerate (Forsgren et al)
Radical Candor (Scott)
Where Good Ideas come from (Johnson)
How to Measure Anything (Hubbard)
Lean Startup (Ries)
The Leaders Guide to Radical Management (Denning)
One more for the bookshelf that we didn't call out is Principles of Product Development Flow (Reinertsen)
It's a bit of a meandering discussion this time, but we dance around the role of teams that support other teams success.
Here's the blog post link Brent refers to in the podcast - Test Doesn't Understand the Customer
Just Brent and Alan this week. We talk about how Program Management can help with Modern Testing and Accelerating the Achievement of Shippable Quality… …but mostly Alan tries to explain to Brent that Product Management is different than Program Management, no matter what titles Microsoft use. Worth reading on the topic: https://leanpub.com/agileprogrammanagement
Brent and Alan are joined by Maaret Pyhäjärvi, who talks with us about her role, the role of testing in general, mob programming, and a whole lot of other topics. I hope this was the beginning of a longer conversation, and we hope to have Maaret as a guest again soon. Maaret’s blogMaaret’s book on […]
Sue Loh (@suedeyloh on twitter). Sue has a lengthy history of finding and fixing nasty performance issues across a lot of different operating systems at Microsoft, but we spend most of our time talking about her Evil Plan To Save The World Get a copy of Sue’s excellent book, Raven, today
For this episode, we are joined by David Bishop – the author of a new book called Metagility. There’s a lot of good stuff here, and we think you’ll find it interesting. Links for more info: Book information – https://www.jrosspub.com/metagility.html David’s company – https://agile-worx.com Current course schedule – https://www.metagility.technology
Melissa Eaden is in the hot seat this week to talk about management, leadership, modern testing, and more. Melissa’s blog: https://testingandmoviesandstuff.blogspot.com/ Melissa on Twitter: @melthetester
Yuliya Bagriy (known across the internet as aviskase) is my guest this time. We talk about her path into testing, a bit about her new role, and the origin of the alias, ‘aviskase’ – which includes a tangent on how she broke Postman.
I’m joined by Chris Kenst, who talks about his path into testing, his job as an automation engineer (which he convinces me not to hate), and his work with AST. He also mentions these links. His job – https://bloomnation.com AST – https://associationforsoftwaretesting.org Blog – https://www.kenst.com List of test conferences – https://testingconferences.org Testing education resources – […]
Conor is back for more questions on Modern Testing. As with last time, you can follow him on Twitter (@conorfi) and read his blog here. Intro Music from https://filmmusic.io “Werq” by Kevin MacLeod (https://incompetech.com) License: CC BY (http://creativecommons.org/licenses/by/4.0/)
Happy New Year! This week, we react to a 15 -year-old paper, and then somehow segue into talking about a few other papers. Papers mentioned: The Ongoing Revolution in Software Testing By Cem Kaner State of DevOps 2019 An Analysis of the Effect of Code Ownership on Software Quality across Windows, Eclipse, and Firefox by Nachi Nagappan
In this 343, Conor Fitzgerald and I talk about his experiences in testing, his experiences in Modern Testing, and a whole lot more. More info: Follow Conor on twitter: @conorfi Read his blog Also worth linking is Elisabeth Hendrickson’s Explore It!
In this 343, I’m joined by one of the long-time listeners and supporters of the AB Testing Podcast, the one and only, Perze Ababa. We talk (mostly) about leading a quality culture, but as you’d expect, we take a few tangents along the way. Perze is @perze on twitter – follow him!
Maciej Wyrodek joins the 343 podcast to talk about his experiences with modern testing, The Unicorn Project, and various rants about the state of software testing. Follow Maciej On twitter – @maciejwyrodek His blog – The Broken Test Also mentioned: The Modern Testing Principles mindmap Polish article on the state of testing
I am joined this time by Areti Panou. Listen in to hear more about her changing role, and her experience with modern testing. Areti’s blog is unremarkabletester.com, and you can folllow her on twitter – @unremarkableqa
Our guest is Dave Westerveld. We talk a bit about accessibility, challenges in testing LMS software, and a lot of “modern” topics. Follow him on twitter @offbeattesting, and his blog at https://offbeattesting.com/
it’s a mailbag show, where we talk about whether or not bugs in Windows 10 are due to a lack of a test team, and how you can apply MT principles if you’re a consultant asked to write automation. Once again, the audio isn’t awesome, but quality debugging continues.
Good news: We have a new episode!Bad News: I am doomed to never having another podcast without audio issues. My mic cable must have been lying across the speakerphone in the conference room, as it was picking up a massive amount of static. I was able to remove the static (you’ll thank me), but removing […]
Heads up – our technical producer (me) messed up levels and microphone choice and we ended up with a little bit of bleed between microphones that ends up not meeting our normally high quality standards. The next one will be better. For content, we talk a lot about what we’re seeing in the industry that […]
We are joined by the inventor of Selenium, Jason Huggins. Listen in for stories about the early days of Selenium, Jason’s thoughts on our UI rants, and much much more. Be sure to check out Jason’s latest venture – Tapster
Alan recently took some heat on Twitter for disliking Selenium – or more accurately, how it was being used. This episode is a discussion and expansion of why Alan and Brent both have strong feelings about the industry infatuation with UI testing.
We realize during the intro, that this is the first time we’ve recorded an AB Testing podcast when neither Alan nor Brent are in a dedicated testing / QA role. What does that mean for Modern Testing? Turns out – not that much. Listen as we discuss.
We talk very abstractly about Alan’s new role, and dive into a mailbag question on the role of leadership in a quality culture. This episode is brought to you by Practitest – check them out at https://www.practitest.com
An all mailbag show where we talk about skills needed by testers today, how to get developers to write tests, and hiring. Register for Brent’s AST webinar on Thursday – https://www.associationforsoftwaretesting.org/2019/01/23/webinar-building-a-data-centric-modern-quality-culture-with-brent-jensen/
Happy Holidays to each and everyone of our three listeners. We review and reflect on 2018, and talk about some things we think may happen in 2019. Listen all the way to the end for a cliffhanger from Brent. Thanks again for listening – in 2019, we will hit episode 100, our 5 year podacting […]
It’s the penultimate show of 2018, with a lot of (hopefully interesting) preamble on this one, but we spend a chunk of time reviewing the Context-Driven Testing Principles and how they relate to the Modern Testing Principles.
We eventually talk about a model Alan built to help a team discover where they need to grow in order to build a quality culture or move towards modern testing (they’re kind of the same thing). Some rants and ramblings also included.
We almost (but not quite) blast through the banter at the beginning, but eventually get a chance to talk a bit more about interpreting Principle #5, and dive into a James Bach talk on the Test Automation Pyramid.
It’s the last of our deep-dive series on Modern Testing Principles. This time, we discuss the (sometimes controversial) principle number 7: We expand testing abilities and knowhow across the team; understanding that this may reduce (or eliminate) the need for a dedicated testing specialist. Not too many tangents this time. Next time, we’ll get caught up […]
On to the next principle in our deep dive series. Principle Number 6 says: We use data extensively to deeply understand customer usage and then close the gaps between product hypotheses and business impact. Note that episode 82 makes a nice listening companion.
We’re back to discuss another of the modern testing principles. We believe that the customer is the only one capable to judge and evaluate the quality of our product Discussions include a brief discussion of the Kin phone from Microsoft. Finally – if you missed it, the Modern Testing AMA recording is here.
Our dive into the Modern Testing Principles continues with a dive into principle number four: We care deeply about the quality culture of our team, and we coach, lead, and nurture the team towards a more mature quality culture.
On to Principle number 3 (full list at moderntesting.org). We are a force for continuous improvement, helping the team adapt and optimize in order to succeed, rather than providing a safety net to catch failures. As promised in the show, there will be an AMA on Modern Testing hosted by Ministry of Test on July […]
We’re back to the MT Principle Deep-Dives (which may just be medium dives). Principle #2 says: We accelerate the team, and use models like Lean Thinking and the Theory of Constraints to help identify, prioritize and mitigate bottlenecks from the system. We talk about that – but of course, there are a few tangents we […]
We are already taking an interlude from principle deep-dives to reflect a bit on the episode 81 feedback, and for Brent and Alan to have short (but in depth) discussion on how to get started creating actionable metrics. We’ll be back to Modern Testing principles in episode 83.
We don’t reiterate the Principles directly (see the Episode 77 show notes for that), we talk a lot about how we are adapting the principles slightly based on feedback and discussions with the three – and how much better the principles are for the effort. We also discover that both Brent and Alan love to cook. […]
We discuss, vet, and rewrite (and not for the last time), the Modern Testing Principles. These are a work in progress, but we’re happy to share the current final form. Listen to the podcast to hear these developed in real time. The customer is the only one suitable to judge and evaluate the quality of […]
First show of 2018, with a variety of topics that are all mostly about Modern Testing. Items of note include the State of Testing survey, podcast plans for 2018, Alan’s presentation schedule, and the usual amount of tangents. Links: AST Webinar (Alan presenting) State of Testing Survey
It’s the 2017 year end extravaganza with discussions about 2017, thoughts and predictions about 2018, and more…including… The AB Testing Merchandise shop – http://cafepress.com/abtesting And, sign up for Audible with AB Testing http://audibletrial.com/abtesting We’ll be back in 2018.
It’s the penultimate AB show of 2017. More discussions about modern testing, a bit of a preview of what’s coming up in episode 73, the role of a modern tester in code craftsmanship, and a bit on this shift-left thing.
In this eclectic episode, we discuss college savings plans, personal finance (wtf?), definitions of “Modern Testing”, and recap the Unity Services Test Summit (where Brent presented on moving to a data-centric culture). Enjoy.
We had a brief break in recording, but we’re back with another fun-filled fifty minutes where we take mailbag questions on the pros and cons of ISTQB certification, the impact of easy-to-create GUI tests on the testing pyramid, and whether or not you really need a data scientist.
We spend a chunk of time talking about a report (The State of Functional Testing), and how it aligns with modern testing. We answer a #mailbag question elaborating on the role of a modern tester, and we get to hear Brent functioning on just a few hours of sleep.
A bit of a follow up episode with more management advice. We talk about how to give feedback to our employees and about frameworks and approaches we like for giving that feedback. This episode brought to you by STAR Canada. If you are thinking about attending, STARCANADA is offering 20% off your conference fees […]
It’s the AB Testing Management episode. We reflect a bit on our growth as managers and share some of the tools and philosophies that (we hope) allow us to succeed. Some of the books mentioned include (also note the link on the right for a free month of Audible): The Leaders Guide to Radical Management […]
We talk about Agile Testing (both the concept and the book), and how it relates to the “Modern Testing” we’ve talked about before. Also – there’s a mailbag question on Multi Armed Bandit Testing. This episode brought to you by the folks at Techwell. Attend Agile Dev East, the premier agile event covering the latest […]
More talk about data, CIRA (collect-inform-recommend-act), and Brent gives Alan free advice on maturing a data aware organization. We mention the great Douglas Hubbard book – How To Measure Anything This AB Testing brought to you by Kobiton Test your mobile app on real cloud based devices today! Kobiton is the complete mobile device cloud […]
It’s an all mailbag show, with questions (and answers) about Model-Based testing; if testers are being (or will be) phased out – or if the role of the tester is simply evolving and expanding (and if the expanded role needs a new name); and some expansion on the Collect-Inform-Recommend-Act model. This episode sponsored by the […]
It had to happen – it’s an all-tangent show! But, somehow we manage to cover a lot about technical testing, data science, tester mindset and more. Alan mentions a lot of books on this episode – here’s the list with amazon links. Steal like an artist Everybody Lies Wonderland What every BODY is saying And […]
Here at AB Testing, we like this episode a lot. Give it a listen and let us know what you think. More on modern testing, and we break down “accelerating the achievement of shippable quality” in the mailbag segment.
We are back with Rants, Rages, and Regurgitated information from the world of software engineering, and software quality. Topics include just a bit of chat about checking and testing, and then a deeper dive into the topic of “Modern Testing”. This episode brought to our listeners by Kobiton. Test your mobile app on real devices […]
This time on AB Testing, we share the microphone with automation expert, Hans Buwalda. We talk with Hans a lot about his views on test design and test automation, including action-based testing (one of the other AB testing types), as well as his upcoming talks at STAR conferences. This episode brought to our listeners by Kobiton. […]
Took a while, but we’re back and ranting away. This time, we talk about the role of Test / Quality as, Accelerating the achievement of shippable quality, and, in a newly named segment called, “Alan talks about working at Unity”, Alan aswers a mailbag question about his approach to change working at Unity.
It’s the double-nickel episode of AB Testing. Included in today’s ramblings are: Alan and Brent talk about graduate school, and learning in general, as well as our thoughts on Dr. Seuss’s greatest works Our sponsor, Techwell, is offering a $250 discount on upcoming software training classes in Boston and Chicago using the promo code 17ABW – […]
It’s our 2016 end-of-year extravaganza – if extravaganza means Brent and Alan randomly talking about their favorite software moments of 2016. We also recorded our 2017 predictions…but audio went haywire, so we’ll have to wait for a re-hash of that topic in early 2017. Notes! Blogs: – http://andrewgelman.com/ – http://dataminingblog.com Blog Posts: – https://knowledgetester.org/2016/09/20/generalist-specialist-t-and-pi-shaped-testers/ – http://www.dataminingblog.com/the-5-most-common-data-relationships-shown-through-visualization/ […]
Live from Test Bash in Philadelphia, this is VAMP Testing with three of the three (Vernon Richards (@testerfromleic), Michael Richards (@saltygunner), and Perze Ababa (@perze)). We discuss sessions at TestBash along with the appropriate number of tangents.
This episode is dedicated entirely to the topic of how to transition from data oblivious to a data-centric organization. Very little Alan yelling at Brent, but a whole lot of Brent preaching goodness about how to use data to advance product quality.
Hey – audio is much better this time. Episode 43 includes discussions of test generation tools, learning, and whether or not Microsoft is a good example of advancing engineering. Don’t forget – use the promo code ABTESTING when you register for StarWest to get a $200 discount (or go to http://well.tc/starwestab)
First off, the audio on this episode has a few issues – we’ve taken steps to improve that in the future. The content includes Alan being Angry, the concept of “Feature Jam”, discussion about CDT, and a bit about data driven engineering.
Live, on the air, we reply to a tweet that kicks off oneofthethree.slack.com. And then Brent (inspired by Patrick Prill aka @testpappy) asks Alan to define Quality, Testing, Test Cases, Testers, Integration Testing, and a few other terms that are difficult to define for most of the three, including (especially?) Alan.
It’s been two years, and 36 episodes…of the same stuff. Yet people still listen. This episode includes some discussion of shipping every day (or at least more often than once a week), open space work areas, and what could be our own AB Testing record for tangents within a podcast!
Another AB Testing podcast in the books (and on the web). This time, we discuss the nature of bugs, why we don’t want our testers back; and in the mailbag session, discuss our role in backlog grooming and planning.
It’s the 2015 recap show, where Brent and Alan reflect on 2015, and make some predictions for 2016…and somehow take nearly an hour to do so. Some links from the show Podcasts: This American Life – Episode 403: Nummi – http://www.thisamericanlife.org/radio-archives/episode/403/transcript Freakonomics Radio – http://freakonomics.com/radio/freakonomics-radio-podcast-archive/ Wait Wait Don’t Tell Me – http://www.npr.org/podcasts/344098539/wait-wait-don-t-tell-me Good Job Brain – http://www.goodjobbrain.com/ Total Soccer […]
This episode is all about “stuff Alan and Brent did” – or at least it started that way until we start rambling. Quick recaps of the Strata conference, Eurostar, Redfin, and Riot all find their way into our discussion.
From the offices of Redfin in Seattle, Washington, Brent and Alan deliver the first ever AB Testing roadshow. Sound isn’t fantastic, and the content, as usual, isn’t very original, but I’m sure one of us said something that will raise your eyebrows. Thanks to Evan and everyone else at Redfin for hosting us, feeding us […]
Yet another installment of AB Testing (including what I think is a world record for AB Testing release velocity). This episode includes another rant from Alan about dumb things people do at Microsoft, a long tangent on Alan’s music background that has no relevance whatsoever, and some discussion on upcoming public appearances from Brent and […]
In their patented pattern of pure randomness, Alan and Brent talk about the context-driven school of testing, the video music awards, upcoming test conferences, and pointy-haired managers! Errata: Lessons learned…came out in 2001 (not 2003 as Alan guessed on the show). A link to Ioana’s awesome CAST talk is here
A trip report from STAR Canada; some discussion of whether or not test is dead (or if being dead is dead), and a trip into the mailbag to talk about monolithic test systems. And Alan fixed the bug that was hiding the media bar on the blog site.
It’s Alan’s 20-year anniversary at Microsoft…and he has a new job. We also talk preview Alan’s talk on A/B (with the slash) testing at Better Software, and attempt to get through some mailbag items without getting too distracted (we failed).
In this episode, Alan and Brent talk about dashboards, scorecards, buzzwords, soapboxes, and Alan’s appearance on another podcast. Also included is yet another installment of silly things people do at work to incur the wrath of Alan.
Brent has a new job! We talk about what Brent does, discuss interviews, and what test specialists actually (may?) do. And other stuff. Here’s the link for the Data Science in the Cloud e-book mentioned in the podcast.
In our last podcast of Twenty-Fourteen, Brent and I talk about Generalizing Specialists, Specializing Generalists, and weird things Alan sees at Microsoft (and other random topics that pop up along the way). Happy Holidays everyone
Alan and Brent are back. In this episode, they discuss interviews, data driven engineering, knowledge sharing and the usual grab bag of tangents and random topics related to software and software quality.
After a long break, Brent and Alan are back with Episode 10. This week, A & B talk about what changed at Microsoft this summer, what they think is going to change next, and talk a bit about the latest IOS bug. Note: the audio is a little wonky this week. Long story, but it […]
In this “all-mailbag” episode, we talk more about change (specifically some changes in engineering approaches we see at Microsoft, including changes in the way we lead and manage people), and a variety of related (and not-so-related) rants. Enjoy.
In this episode, Brent and Alan discuss Alan’s upcoming trip to the STAR East test conference, and a bit about using Kanban for chores. And then comes a question / statement about estimation that’s worth every minute.