Hello everyone, this is the first time we meet. I am CodeFuse, the ant code model. My mission is to improve programming efficiency for developers.
Let me tell you some good news! At the recent Bund Conference, I officially made it open source. You can go to GitHub, HuggingFace and Moda community to download and deploy, and let’s play together~
CodeFuse is a large code generation model independently developed by Ant. It provides intelligent suggestions and real-time support based on developer input, helping developers automatically generate code, automatically add comments, automatically generate test cases, repair and optimize code, etc., to improve research and development efficiency. . Whether the user is a beginner or an experienced developer, CodeFuse can greatly improve programming efficiency and accuracy. Make everyone programmable and innovative a reality.
CodeFuse is developed based on the large basic Ant model. In the recent HumanEval evaluation of code completion, CodeFuse scored 74.4%, ranking among the best in the world among open source models. This open source content includes code frameworks, models, etc., which are now available on relevant platforms. The models can be downloaded from HuggingFace and Moda communities.
As early as January 2022, Ant Group established a special code intelligent generation project. With the advancement of the company's overall strategy, with the support of unified software and hardware infrastructure, multiple large code models were trained from zero to one, and finally based on the 13B version , created CodeFuse and started internal testing in June this year. It is used in a real development environment to help developers with low-threshold programming, such as writing H5 mini-games in natural language, quickly developing Alipay mini-programs, etc.
Application scenarios based on CodeFuse include development assistants, IDE plug-ins, data analyzers, etc., which cover the main needs of current research and development work and have been gradually verified in Ant Group's internal research and development process.
The purpose of CodeFuse is to redefine next-generation AI research and development and provide full life cycle AI assistance tools. Ant Group hopes to work with the community to promote a paradigm shift in the field of software engineering through open source CodeFuse, reshape various fields of software research and development, and accelerate the digitalization process in all walks of life.
CodeFuse open source address
GitHub：https://github.com/codefuse-ai
HuggingFace：https://huggingface.co/codefuse-ai
Codefuse Community: https://modelscope.cn/organization/codefuse-ai
CodeFuse's mission is to develop large-scale code language models (Code LLMs) specifically designed to support the entire software development life cycle, covering key stages such as design, requirements, coding, testing, deployment, operation and maintenance. The development team is committed to creating innovative solutions that make the development process for software developers silky smooth.
Currently, CodeFuse has open sourced the following content:
-
MFT (Multi-Task Fine-Tuning) framework, also known as MFTCoder;
-
Two data sets used to enhance the coding capabilities of LLMs, including Code Exercise and Evol-Instruction;
-
A faster and more reliable deployment framework based on FasterTransformer.
The resulting collection of models includes CodeFuse-13B and CodeFuse-CodeLlama-34B, which support a variety of code-related tasks, such as code completion, text-to-code, unit test generation, etc. We plan to incorporate more basic LLMs into our model collection in the near future.
CodeFuse's solution can significantly improve the performance of pre-trained LLMs on multiple related tasks. The team will further explore this direction and provide more open source contributions. At the same time, CodeFuse sincerely invites like-minded engineers and researchers to join this community and build CodeFuse together.
For more technical information, usage tips, and the latest information, please follow CodeFuse. We will share it with you as soon as possible ~
Lei Jun: The official version of Xiaomi’s new operating system ThePaper OS has been packaged. A pop-up window on the Gome App lottery page insults its founder. The U.S. government restricts the export of NVIDIA H800 GPU to China. The Xiaomi ThePaper OS interface is exposed. A master used Scratch to rub the RISC-V simulator and it ran successfully. Linux kernel RustDesk remote desktop 1.2.3 released, enhanced Wayland support After unplugging the Logitech USB receiver, the Linux kernel crashed DHH sharp review of "packaging tools": the front end does not need to be built at all (No Build) JetBrains launches Writerside to create technical documentation Tools for Node.js 21 officially released