DO NOT expect Wall Street to open-source LLMs nor open APIs.
The data sources and our wapper for large language models (LLM) are put separately in FinNLP
Disclaimer: We are sharing codes for academic purpose under the MIT education license. Nothing herein is financial advice, and NOT a recommendation to trade real money. Please use common sense and always first consult a professional before trading or investing.
1). Finance is high dynamic. BloombergGPT trains an LLM using a mixed dataset of finance and general data sources, which is too much expensive (1.3M hours, a cost of around $5M). It is feasible to retrain every month or week, so lightweight adaptation is highly favorable in finance.
2). Internet-scale finance data is critical, which should allow timely updates (monthly or weekly updates) using an automatic data curation pipeline. BloombergGPT has privileged data access and API access, but a promising alternative is "democratizing Internet-scale financial data".
3). Another key technology is "RLHF (Reinforcement learning from human feedback)", which is missing in BloombergGPT. RLHF enables learning individual preferences (risk-aversion level, investing habits, personalized robo-advisor, etc.), which is the ``secret" ingradient of ChatGPT and GPT4.
- Columbia Perspectives on ChatGPT
- [MIT Technology Review] ChatGPT is about to revolutionize the economy. We need to decide what that looks like
- [BloombergGPT] BloombergGPT: A Large Language Model for Finance
- [Finextra] ChatGPT and Bing AI to sit as panellists at fintech conference
-
[YouTube video] I Built a Trading Bot with ChatGPT, combining ChatGPT and FinRL.
-
- A demo of using ChatGPT to build a Robo-advisor
-
- A FinRL agent that trades as smartly as ChatGPT by using the large language model behind ChatGPT
-
- Trade with the suggestions given by ChatGPT
-
ChatGPT adds technical indicators into FinRL
- Sparks of artificial general intelligence: Early experiments with GPT-4
- [GPT-4] GPT-4 Technical Report
- [InstructGPT] Training language models to follow instructions with human feedback NeurIPS 2022.
The Journey of Open AI GPT models. GPT models explained. Open AI's GPT-1, GPT-2, GPT-3.
- [GPT-3] Language models are few-shot learners NeurIPS 2020.
- [GPT-2] Language Models are Unsupervised Multitask Learners
- [GPT-1] Improving Language Understanding by Generative Pre-Training
- [Transformer] Attention is All you Need NeurIPS 2017.
-
[BloombergGPT] BloombergGPT: A Large Language Model for Finance
-
WHAT’S IN MY AI? A Comprehensive Analysis of Datasets Used to Train GPT-1, GPT-2, GPT-3, GPT-NeoX-20B, Megatron-11B, MT-NLG, and Gopher
-
FinRL-Meta Repo and paper FinRL-Meta: Market Environments and Benchmarks for Data-Driven Financial Reinforcement Learning. Advances in Neural Information Processing Systems, 2022.
-
[AI4Finance] FinNLP Democratizing Internet-scale financial data.
- GPT-3 Creative Fiction Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.
ChatGPT Trading Bot
- [YouTube video] I Built a Trading Bot with ChatGPT combining ChatGPT and FinRL.
- [YouTube video] ChatGPT Trading strategy 20097% returns
- [YouTube video] ChatGPT Coding - Make A Profitable Trading Strategy In Five Minutes!
- [YouTube video] Easy Automated Live Trading using ChatGPT (+9660.3% hands free)
- [YouTube video] ChatGPT Trading Strategy 893% Returns
- [YouTube video] ChatGPT 10 Million Trading Strategy
- [YouTube video] ChatGPT: Your Crypto Assistant
- [YouTube video] Generate Insane Trading Returns with ChatGPT and TradingView
- [YouTube video] This Ai Forex Trading Strategy Will Make you RICH!? (Chat GPT)
(Fast and accurate) Sentiment Analysis
GPT-3 can help study customer surveys, social media tweets from customers/users.
Tweets
PromptNet Analogy to ImageNet and WordNet, it is critical to build a PromptNet.
Robo-advisor
Coding-tutor
Blogs about ChatGPT for FinTech
Prompting as a new programming paradigm!
-
[Towards Data Science] GPT-3: Creative Potential of NLP
-
[YouTube video] OpenAI GPT-3 - Prompt Engineering For Financial NLP
-
[YouTube video] Advanced ChatGPT Prompt Engineering
-
GPT-3 Sandbox (Github) Enable users to create cool web demos using OpenAI GPT-3 API.
-
Exploring the Capabilities of the ChatGPT API: A Beginner’s Guide
Prompting programming
Interesting evaluations:
[YouTube] Physics Solution: ChatGPT vs. Google