The company has launched pretrained and fine-tuned models with 7B, 13B, and 70B parameters. (Express Image/Pixabay)
Listen to this articleYour browser does not support the audio element.
Tech giants are in an intense race to offer the latest and the best in Artificial Intelligence. On Wednesday, Mark Zuckerberg’s Meta announced that it was partnering with Microsoft to introduce Llama 2, its next-generation open-source language model.
Meta CEO said that the model will be soon available to researchers and other commercial use for free. The latest powerful model has been tipped to go up against OpenAI’s GPT-4. In a Facebook post announcing the launch, Zuckerberg said that Meta has a long history of open-sourcing its infrastructure and AI work – from PyTorch, the leading machine learning framework to Segment Anything, ImageBind, and Dino. He said that open-sourcing has helped Meta build better products and drive progress across the industry.
You’ve Read Your Free Stories For Now
Sign up and keep reading more stories that matter to you.
Meta said that Llama 2 will unlock more progress across the AI ecosystem. The company has launched pretrained and fine-tuned models with 7B, 13B, and 70B parameters. In his post, Zuckerberg said that Llama 2 was pre-trained on 40 per cent more data than its predecessor and also has improvements to its architecture. For now, users can download these models through Azure along with Microsoft’s safety and content tools.
Llama 2 decoded:
Llama 2 was created within a research lab in Meta, by a team led by Yann LeCun who is hailed as one of the founding fathers of neural networks. Reportedly, Llama 2 has outperformed GPT-3 and is similar to ChatGPT when it comes to chat model quality. However, it lacks the ability to code.
The company has carried out some extensive safety evaluations and has deployed techniques such as context distillation and Reinforcement Learning from Human Feedback (RLHF). Context distillation is a method to internalise information from abstract instructions, while RLHF is a technique that trains a reward model based on human feedback.
Llama 2 will be available for commercial use when a product made using the model has over 700 million monthly active users. While it is available via Microsoft’s Azure platform, AWS, Hugging Face; Qualcomm is collaborating with Microsoft to integrate the Llama 2 model into phones, laptops, and headsets from 2024. Considering the breadth of potential innovations that Llama 2 has, AI experts feel that it can be a disruptor in the industry.
What can Llama 2 do?
Llama 2 is a large language model (LLM) that can be used to create chatbots such as ChatGPT. LLMs are trained on humongous amounts of data that allow them to replicate human language and even programming. Now that Meta is making Llama 2 open-source, its content will be available for people to access for free and use and tweak to create their own AI chatbots for other purposes.
Story continues below this ad
The objective behind making Llama 2 open source is so that start-ups and other businesses can access it and tweak it to create their own AI products. This could potentially add to the ever-increasing list of chatbots that can rival OpenAI’s ChatGPT or Google Bard.
When asked why Meta is releasing Llama 2 for public use, Meta’s president of global affairs, Nick Clegg told BBC Radio 4 that making LLMs open-source would make them ‘safe and better by inviting outside scrutiny’.
It is also believed that with the open-sourcing of Llama 2, Meta is trying to weaken the competitive edge of OpenAI, Google, etc. Interestingly, Microsoft is the biggest investor in OpenAI, yet it is backing Llama 2.
How can you try Llama 2?
As of now the easiest way to try Llama 2 is via Perplexity AI. Visit llama.perplexity.ai to explore the model. The link will open a chatbox with the greeting “Hello! I am a LLaMa created by Meta AI and brought to life by the Perplexity team. How can I help you?” Users can enter their queries in the input box at the bottom.
Story continues below this ad
We asked the Llama model through Perplexity AI to write a 100-word essay on British colonialism and below is the answer.
“Sure! Here is a 100-word essay on British colonialism:
British colonialism had far-reaching impacts across the globe. From the Americas to Africa, Asia, and Oceania, the British Empire expanded its reach through conquest, trade, and colonisation. While it brought modern infrastructure and technologies to many regions, it also imposed its own culture, language, and values upon indigenous populations. The legacy of British colonialism can be seen in the political, economic, and social structures of former colonies today. However, it is important to acknowledge both the benefits and drawbacks of this period in history, recognizing the suffering and exploitation experienced by many communities under colonial rule.”
There has been widespread apprehension in the tech community about open-source – AI. The primary concern is that open-sourcing would likely make powerful AI tools accessible to all, including bad actors like hackers and criminals. As of now, Meta requires users to agree to an acceptable use policy which includes not using LLMs for disinformation or encouraging violence or terrorism. The Llama 2 model comes with a responsible use guide for developers.
Bijin Jose serves as an Assistant Editor at Indian Express Online in New Delhi. A seasoned technology journalist with a diverse portfolio, he brings over a decade of experience in the media industry to his coverage of the evolving digital landscape and emerging technologies.
Experience & Career
Bijin commenced his journalistic journey in 2013 as a citizen journalist with The Times of India. His career trajectory includes significant tenures at prestigious media organizations including India Today Digital and The Economic Times. This diverse professional background, ranging from legacy print institutions to dynamic digital platforms, culminated in his current leadership role at The Indian Express, where he helps shape the publication's technology narrative.
Expertise & Focus Areas
Bijin has transitioned from general reporting to a specialized focus on the intersection of technology and humanity. His key areas of expertise include:
Artificial Intelligence: deeply tracking developments in AI, providing nuanced perspectives on its ethical,industrial, and societal implications.
Tech Commentary: moving beyond product specifications to analyze how technology reshapes daily life.
Diverse Reporting Foundation: draws upon a robust background in crime reporting and cultural features to bring a human-centric approach to technical storytelling.
Authoritativeness & Trust
Bijin’s editorial voice is informed by a strong academic foundation, holding a Bachelor of Arts in English from Maharaja Sayajirao University, Vadodara, and a Master of Arts in English Literature. This literary background enables him to deconstruct complex technical jargon into accessible, compelling narratives. His steady progression through India’s top newsrooms underscores his reputation for editorial rigor and reliable journalism.
Find all stories by Bijin Jose here ... Read More