GPT-4 ..GPT-4 Technical Report OpenAI

Abstract We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable

This report also discusses a key challenge of the project, developing deep learning infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to make predictions about the expected performance of GPT-4 (based on small runs trained in similar ways) that were tested against the final run to increase confidence in our training. Despite its capabilities, GPT-4 has similar limitations to earlier GPT models [ 1, 31, 32]: it is not fully reliable (e.g. can suffer from “hallucinations”), has a limited context window, and does not learn 

https://cdn.openai.com/papers/gpt-4.pdf?fbclid=IwAR3duxv1DEpVUydrLFwdsSo3VYQnWV7xCFDLOyZD-hH3a2zh5eTil_xDxR4