All

Fine-tuning OpenAI's GPT-3.5 for consumer finance

At Prodigal, one of our core values is: We take action.

And we're serious about that.

Which is why, within a day of OpenAI’s announcement that GPT-3.5 was available for fine-tuning with custom data, we were already using it to enhance our proprietary AI Intent Engine.

Getting to work

“OpenAI released the ability to fine-tune GPT-3.5 on a Thursday and we were able to create fine-tuned models for it by Friday. We are perhaps one out of a thousand companies around the world innovating at that speed and using it to improve our products,” said Akshat Vaidya, Product Manager at Prodigal.

Being able to implement fine-tuned GPT-3.5 within our custom-trained AI solutions immediately delivered improvements for our customers.

Delivering for our customers

And those improvements are the point.

"Our primary goal is to build applications that give creditors actionable insights into consumer finances," said Shantanu Gangal, Prodigal’s CEO.

So we were excited to give GPT-3.5 a try.

Having been in the AI space for years, our AI team has already made use of numerous large language models (LLMs), including XGBoost classifiers, BERT-based models, and LLaMA 2.

And now adding OpenAI’s GPT-3.5 to the mix has only strengthened our models.

“With fine-tuning we can bring all of the millions of calls that we have, that every finance organization has, to bear. We can learn from the best in every organization and we can bring that together to build really high quality models,” explained Harsh Pareek, Senior ML Engineer at Prodigal.

“It’s the marriage of unique proprietary data and unique proprietary technologies,” added Shantanu.

AI for consumer finance

Training LLMs with Prodigal’s extensive custom data has allowed the team to build a suite of solutions specifically for consumer finance. Coupling data curated from over 300 million lending and borrowing interactions with the power of LLMs delivers the ability for Prodigal’s customers to extract new insights from the conversations they have with customers every day.

When GPT-3.5’s fine-tuning abilities were announced, the team was initially apprehensive. While OpenAI “has the best models in the industry,” Pareek said, not being able to train the model on custom data was a real drawback. “Now, with fine-tuning on Prodigal’s proprietary data, you can get performance exceeding that of GPT-4 at really fast speeds.”

The possibilities for consumer finance with Prodigal’s fine-tuned models benefit both customers and companies.

“The borrowing and lending industry has been following these workflows which are ripe to be supercharged by generative AI. We’re still very stuck in our archaic world where everything is template-based. With generative AI and the advent of LLMs, consumer finance teams are going to be able to deliver personalization to customers at a scale that was previously unheard of,” Akshat said.

“Change is the only constant. Technology is evolving rapidly and new paradigms are opening new horizons.  Fine-tuned GPT-3.5 is just one illustration of it. It allows blending proprietary data to improve insights. We always bring these improvements to our customers quickly,” Shantanu concluded.

Want to know more?

Check out the whole conversation with Shantanu, Akshat, and Harsh:

Want to work with these AI Jedi? We're hiring!