A complete guide to 2024

OpenAI may be the most well-known name when it comes to commercial generative AI, but Meta has managed to carve out a niche for itself through powerful open source large language models. Meta revealed its largest generative AI model yet, Llama 3, on April 18, which outperforms GPT-4 in some standard AI tests.

What is Llama 3?

Llama 3 is an LLM created by Meta. It can be used to create generative AI, including chatbots that can respond in natural language to a wide variety of queries. Use cases that Llama 3 has been evaluated on include brainstorming, creative writing, coding, summarizing documents, and answering questions in the voice of a specific person or character.

The full Llama 3 model comes in four variants:

• 8 billion pre-trained parameters.
• Adjusted 8 billion parameter instruction.
• 70 billion pre-trained parameters.
• Adjusted 70 billion parameter instruction.

Llama 3's generative AI capabilities can be used in a browser or through AI features on Facebook, Instagram, WhatsApp, and Meta Messenger. The model itself can be downloaded from Meta or from major enterprise cloud platforms.

When will Llama 3 be released and on what platforms?

Llama 3 launched on April 18 on Google Cloud Vertex AI, IBM's watsonx.ai, and other major LLM hosting platforms. AWS followed up and added Llama 3 to Amazon Bedrock on April 23. Starting April 29, Llama 3 is available on the following platforms:

• Data bricks.
• Hugging face.
• Kaggle.
• Microsoft Azure.
• NVIDIA NIM.

Hardware platforms from AMD, AWS, Dell, Intel, NVIDIA and Qualcomm are supported by Llama 3.

Is Llama 3 open source?

Llama 3 is open source, as have been Meta's other LLMs. Creating open source models has been a valuable differentiator for Meta.

SEE: Stanford AI Index report reveals 8 trends for AI in business today. (Technological Republic)

There is some debate about how much of the code or weights of a large language model should be publicly available to count as open source. But when it comes to business purposes, Meta offers a more open look at Llama 3 than its competitors for its LLMs.

Is Call 3 free?

Llama 3 is free as long as it is used according to the license terms. The model can be downloaded directly from Meta or used within the various cloud hosting services listed above, although those services may have fees associated with them.

Is Llama 3 multimodal?

Llama 3 is not multimodal, which means that it is not capable of understanding data from different modalities such as video, audio or text. Meta plans to make Llama 3 multimodal in the near future.

Improvements of Llama 3 compared to Llama 2

To make Llama 3 more capable than Llama 2, Meta added a new tokenizer to encode the language much more efficiently. Meta improved Llama 3 with clustered query attention, a method to improve the efficiency of model inference. The Llama 3 training set is seven times larger than the training set used for Llama 2, Meta said, and includes four times as much code. Meta applied new efficiencies to Llama 3's pre-training and instruction tuning.

Since Llama 3 is designed as an open model, Meta added guardrails with developers in mind. A new security barrier is Code Shield, which aims to detect insecure code that the model may produce.

What's next for Llama 3?

Goal plans:

• Add multiple languages ​​to Llama 3.
• Expand the context window.
• It generally increases the capabilities of the model in the future.

Meta is working on a 400B parameter model, which can help shape the next generation of Llama 3. In early testing, the instruction-tuned Llama 3 400B scored 86.1 on the MMLU Knowledge Assessment ( an AI benchmark), according to Meta, making it competitive with GPT-4. Llama 400B would be Meta's largest LLM yet.

Llama 3's place in the competitive generative AI landscape

Llama 3 competes directly with GPT-4 and GPT-3.5, Google's Gemini and Gemma, Mistral AI's Mistral 7B, Perplexity AI and other LLMs for individual or commercial use to build generative AI chatbots and other tools. About a week after Llama 3 was revealed, Snowflake unveiled its own open enterprise AI with comparable capabilities, called Snowflake Arctic.

The increasing performance requirements of LLMs like Llama 3 are contributing to an arms race for AI-enabled PCs that can run models at least partially on the device. Meanwhile, generative AI companies may face increased scrutiny for their large computing needs, which could contribute to worsening climate change.

Flame 3 against GPT-4

Llama 3 outperforms OpenAI's GPT-4 on HumanEval, which is a standard benchmark that compares an AI model's ability to generate code with code written by humans. Llama 3 70B scored 81.7, compared to GPT-4's score of 67.

However, GPT-4 outperformed Llama 3 on the MMLU knowledge assessment with a score of 86.4 versus Llama 3 70B's 79.5. Llama 3's performance in further testing can be found in the Meta blog post.

Should your organization use Llama 3?

Assuming you've already decided that generative AI is right for your business, the choice to use Llama 3 will likely depend on availability. Llama 3 can be used for free and customized within larger limits than its competitors.

Llama 3 may be more efficient than its rivals such as GPT-4 or Claude 3 when encoding. However, Llama 3 has other competitors in the encoding space. For example, GitHub recently introduced Copilot Workspace, which is customized for coding and can create code based on natural language prompts.

Llama 3 may be good for your organization if you want a family of open source, general-purpose AI models.