Baidu introduced ERNIE Bot, a new-generation large language model (LLM) and generative AI product

ERNIE Bot is a culmination of years of research and industry practices by Baidu. This new-generation, knowledge-enhanced LLM is built upon Baidu’s in-house models ERNIE (Enhanced Representation of Knowledge Integration) and PLATO (Pre-trained Dialogue Generation Model).

Since its release in 2019, ERNIE has evolved from a natural language understanding model into a model platform with cross-language, cross-modal, cross-industry and cross-task capabilities.

Baidu trained ERNIE Bot using Supervised Fine-Tuning, Reinforcement Learning from Human Feedback, Prompt Learning, Knowledge Enhancement, Retrieval Augmentation, and Dialogue Augmentation.

Robin Li emphasized during a press conference Baidu’s unique position as one of the few companies worldwide offering a full AI stack. This includes AI chip Kunlun, deep learning framework PaddlePaddle, pre-trained model ERNIE, and a variety of applications such as search, AI cloud, autonomous driving, and Xiaodu smart devices. He also highlighted that the advantage of Baidu’s full AI-stack lies in its ability to achieve end-to-end optimization, substantially boosting efficiency. The synergy between framework and model lowers costs and streamlines model development.

Baidu’s PaddlePaddle framework has been employed in developing 4D hybrid parallel technology, which greatly enhances the efficiency of training and inference for mega-scale models. Baidu’s full AI-stack will facilitate a closed-loop system where each layer can offer feedback, helping ERNIE Bot to continue iterating and improving.

ERNIE Bot excels in a range of areas, including understanding Chinese language and culture, generating literary and business writing, performing complex mathematical calculations, and producing multi-modal content.

The AI product can comprehend human intentions and deliver accurate, logical, and fluent responses approaching human level.

ERNIE Bot is currently open to an initial group of users with invitation codes and will soon be made available to more users. Baidu is also offering access to the ERNIE Bot API via Baidu AI Cloud, allowing enterprise clients to apply for and...