CPMAnt
This model was released on 2022-09-16 and added to Hugging Face Transformers on 2023-04-12.
CPMAnt
Section titled “CPMAnt”
Overview
Section titled “Overview”CPM-Ant is an open-source Chinese pre-trained language model (PLM) with 10B parameters. It is also the first milestone of the live training process of CPM-Live. The training process is cost-effective and environment-friendly. CPM-Ant also achieves promising results with delta tuning on the CUGE benchmark. Besides the full model, we also provide various compressed versions to meet the requirements of different hardware configurations. See more
This model was contributed by OpenBMB. The original code can be found here.
Resources
Section titled “Resources”- A tutorial on CPM-Live.
CpmAntConfig
Section titled “CpmAntConfig”[[autodoc]] CpmAntConfig - all
CpmAntTokenizer
Section titled “CpmAntTokenizer”[[autodoc]] CpmAntTokenizer - all
CpmAntModel
Section titled “CpmAntModel”[[autodoc]] CpmAntModel - all
CpmAntForCausalLM
Section titled “CpmAntForCausalLM”[[autodoc]] CpmAntForCausalLM - all