BloombergGPT - an LLM for Finance with David Rosenberg
EPISODE 639
|
JULY
24,
2023
Watch
Follow
Share
About this Episode
Today we’re joined by David Rosenberg, head of the machine learning strategy team in the Office of the CTO at Bloomberg. In our conversation with David, we discuss the creation of BloombergGPT, a custom-built LLM focused on financial applications. We explore the model’s architecture, validation process, benchmarks, and its distinction from other language models. David also discussed the evaluation process, performance comparisons, progress, and the future directions of the model. Finally, we discuss the ethical considerations that come with building these types of models, and how they've approached dealing with these issues.
About the Guest
David Rosenberg
Bloomberg
Resources
- Paper: BloombergGPT: A Large Language Model for Finance
- Blog Post: BloombergGPT
- Bloomberg Query Language (BQL)
- Hugging Face 🤗 BLOOM
- Paper: LLaMA: Open and Efficient Foundation Language Models
- Paper: Measuring Massive Multitask Language Understanding
- BIG-Bench Hard (BBH) Evaluation Suite
- Big Science and Embodied Learning at Hugging Face with Thomas Wolf
- Falcon-7B
- GPT-Neo
