It is a descendant of GPT-3 and has been trained on both natural language and billions of lines of source code from publicly available sources. This enables Codex to generate working code, understand people’s intent, and help everyone do more with computers. OpenAI has made Codex available in private beta via its API and is working closely with developers to understand the impact of the technology while scaling it up safely.