GPT-4 hybrid large model? Research has proven that MoE+instruction tuning does indeed outperform large models

GPT-4 hybrid large model? Research has proven that MoE+instruction tuning does indeed outperform large models

Machine Heart ReportEditor: Xiaozhou, Chen PingGoogle, UC Berkeley, and others have proven that MoE+instruction tuning has worked 1+1> The effect of 2.Since the introduction of GPT-4, people have been amazed by its powerful emergence ability, including excellent language comprehension, generative ability, logical reasoning ability, and so on...

Alibaba Cloud AI Painting Creation Big Model Tongyi Wanxiang Release has opened targeted test invitation

Alibaba Cloud AI Painting Creation Big Model Tongyi Wanxiang Release has opened targeted test invitation

[World Wide Web Technology Report] On July 7, at the 2023 World Artificial Intelligence Conference, Alibaba Cloud announced that the AI painting creation model Tongyi Wanxiang opened a targeted test invitation. The model can help people create pictures and can be used in art design, e-commerce, games, cultural creation and other application scenarios in the future...

Alibaba Cloud launched a big model assistant, Magic GPT, which can call all big models with one click

Alibaba Cloud launched a big model assistant, Magic GPT, which can call all big models with one click

On July 7th, at the World Artificial Intelligence Conference in Shanghai, Zhou Jingren, CTO of Alibaba Cloud, said in his speech: "Alibaba Cloud will take the promotion of the prosperity of China's big model ecosystem as the primary goal, provide a full range of services to big model start-ups, including the most powerful intelligent computing power and development tools, and provide full support in terms of funding and commercialization exploration. Alibaba Cloud's magic building community has gathered 1...

The Evolutionary Trajectory of the Large Language Model

The Evolutionary Trajectory of the Large Language Model

ChatGPTLLMLLMAILLMChatGPTLLMAILLMEtienne BernardNuMindCEOLLMNLPEtienneWolfram ResearchOneFlowOneFlowhttps://www.numind...

The

The "Hundred Model Battle" is becoming increasingly fierce, and vertical field application innovation becomes the key to breaking the situation

Our reporter Li YuchengIntern journalist Ding RongSince the beginning of this year, China's large model industry has flourished, and the popularity of the track has continued to rise. At the Artificial Intelligence Summit Forum of the 2023 Global Digital Economy Conference held recently, Jiang Guangzhi, Secretary of the Party Leadership Group and Director of the Economy of Beijing Municipal Bureau of Economy and Information Technology, said that more than 80 major models have been released nationwide...

Tianyancha collaborates with Huawei Cloud to release the world's first commercial search model

Tianyancha collaborates with Huawei Cloud to release the world's first commercial search model

On July 2nd, Beijing Jindi Technology Co., Ltd...

Don't worry about buying a car during the summer vacation. Take a look at these four models and make a choice starting at 1799 yuan

Don't worry about buying a car during the summer vacation. Take a look at these four models and make a choice starting at 1799 yuan

Don't worry about buying a car during the summer vacation. Look at these four models and find out the answer...

30 large models are about to appear at the 2023 World Artificial Intelligence Conference

30 large models are about to appear at the 2023 World Artificial Intelligence Conference

Global Network Technology Comprehensive Report: It is reported that the 2023 World Artificial Intelligence Conference will be held from July 6th to 8th at the Shanghai World Expo Center and World Expo Exhibition Hall, with the theme of "Smart World Generating the Future". Wu Jincheng, Director of the Shanghai Municipal Commission of Economic Informatization, revealed at a press conference held by the Shanghai Municipal People's Government on June 29th that this year's World Artificial Intelligence Conference will further focus on the new trend of industrial and technological transformation, focusing on various aspects such as large models, intelligent computing, scientific intelligence, and embodied intelligence, to accelerate the innovation and evolution of the new generation of artificial intelligence technology...

The largest cloud based research and intelligent computing platform for Chinese universities has been launched, and the public cloud model has significantly improved the efficiency of computing power utilization

The largest cloud based research and intelligent computing platform for Chinese universities has been launched, and the public cloud model has significantly improved the efficiency of computing power utilization

On June 27th, the largest cloud based research and intelligent computing platform CFFF (Computing for the Future at Fudan) in Chinese universities was officially launched at Fudan University. This scientific research "supercomputer" built to discover and solve complex scientific problems was jointly built by Fudan University and Alibaba Cloud...

From the domestic AI giants to the global top five big model companies, how can cloud take it easy?

From the domestic AI giants to the global top five big model companies, how can cloud take it easy?

In the chaotic era of big models, Cloud has finally taken the first step in its own way.On May 30th, Yun Cong Rong announced the official launch of the public beta for the large model, which was less than two weeks after its debut on May 18th...

Complete List of Open Source Large Language Models

Complete List of Open Source Large Language Models

Large Language Model (LLM) "" AI (prompt)LLM LLM LLMChatGLM-6B ChatGLM-6B General Language Model (GLM) 62 INT4 6GB ChatGLM-6B ChatGLM 1T 62 ChatGLM-6B VisualGLM-6B VisualGLM-6B ChatGLM-6B 62 BLIP2-Qformer 78MOSS MOSS moss-moon 160 FP16 A100/A800 3090 INT4/8 3090 MOSS DB-GPT DB-GPT GPT GPT 100% 100% DB-GPT CPM-Bee CPM-Bee Transformer auto-regressiveCPM-Bee OpenBMB CPM-Bee CPM-Bee CPM-Bee OpenBMB OpenBMB CPM-Bee OpenBMB CPM-Bee CPM-Bee LaWGPT LaWGPT Chinese-LLaMAChatGLM (Linly) 32*A100 GPU baseline33B Linly-Chinese-LLAMA LLaMA CUDA CPU Huggingface Linly-Chinese-LLaMA LLaMA 7B13B 33B 65B Linly-ChatFlow 400 7B13B Linly-ChatFlow-int4 ChatFlow 4-bit CPU Linly-Chinese-BLOOM BLOOM 7B 175B Chinese-Vicuna LLaMA Chinese-Vicuna LLaMA+Lora finetune CPU ( C++) / / Facebook llama.ckpt Chinese-LLaMA-Alpaca LLaMA & Alpaca Chinese-LLaMA-Alpaca LLaMA Alpaca LLaMA Alpaca ChatYuan ChatYuan ChatYuan-large-v2 v1 ChatYuan-large-v2 ChatYuan PC INT4 400M GPT HuatuoGPT GPT ChatGPT HuatuoGPT ChatGPT LLaMA (BenTsao) (HuaTuo) LLaMA / (Instruct-tuning) LLaMA-7B GPT3...

New feature launched on WeChat: Silent everything in

New feature launched on WeChat: Silent everything in "quiet mode"

[Global Network Technology Comprehensive Report] On June 21, the reporter learned from the "WeChat faction" official account that WeChat has launched a new function - "quiet mode".It is understood that when updating to the latest version on iOS WeChat, you can turn it on through "WeChat" - "Me" - "Settings" - "Care Mode" - "Quiet Mode"...