Dev Update: Liar, Liar, Pants on Fire!
We’re back with a technical update on boodleGPT’s development. You’ll hear from Kisa Brostrom, Chief Data Officer at boodleAI, and Ansel Teng, Chief Technology Officer at boodleAI, again this week as they share boodleGPT’s progress, or as we are fondly calling it – the toddler.
Data Team Update
Chief Data Officer of boodleAI, Kisa is affectionately referred to as “Queen Kisa”, responsible for all things data. A mechanical engineer by education, she’s built her career on growing data teams from scratch and developing useful, practical solutions. When she’s not herding cattle in her minivan, she’s raising the next generation of data artists (9, 6, 3) on a farm in Oklahoma. Connect with Kisa on LinkedIn.
“Liar, Liar, Pants on Fire!” A childhood phrase we are all familiar with. And it perfectly sums up the work we have been doing on the Data team over the past week.
After we successfully integrated our systems, we launched into two very important phases of development: fine tuning and testing. We needed to test our systems so we could have a benchmark to measure ourselves against as we tune the system. You have to know where you are before you can get where you are going.
And as expected, without any tuning, our system lied… a lot. Hallucinations (as they are called) are a VERY common issue with LLMs. In a different blog post we will go in-depth on how we are addressing them but for now I will just say that like any good parent, we are currently teaching our child the difference between right and wrong. And like most toddlers, our LLM is currently only listening half of the time.
But we have a clear path forward and like every proud parent, we take tremendous joy in seeing boodleGPT grow before our very eyes.
Tech Team Update
Chief Technology Officer of boodleAI, Ansel is a senior technology leader since the dot com days. He has a Ph.D. in computer science and has been managing software product and system development in organizations of all sizes, from small startup to global enterprise. Connect with Ansel on LinkedIn. He loves to connect with fellow technology leaders.
Our development team is moving at a blazing fast pace. At the end of last week, we pieced all parts of the “car” together (see our last update for the car metaphor) and turned on the ignition.
Voila! It appears to be working… but somewhat erratically. After working out a few kinks, we moved it into QA at the end of day Monday and opened it up for everyone in the company to try it out. Our Co-CEO France of course immediately pushed it over the speed limit and it … sputtered. In quick response, the techies huddled in the pit and found the fuel connection clogged. It was fixed overnight, and the car is back on the test track again. Woohoo!
We are now adding the finishing touches and getting ready for alpha testing with select external users next week!