OPT (Open Pretrained Transformer) is a series of open-sourced large causal language models which perform similar in performance to GPT3.