![]() ![]() Once the application receives the user’s query the request is sent to the Lambda endpoint so it can be processed. In section one of the diagram above, the user is communicating with the frontend application that will send requests to the Jurassic-2 model via the Lambda endpoint. In this section, we’ll briefly review each part of the architecture that allows you to call the Jurassic-2 large language model.įigure 1 – Using the Jurassic-2 model via AWS Lambda endpoint. Moreover, they do not require prompt engineering and can be rolled out into production in a matter of minutes.įor the remainder of this post, we’ll focus on using the Jurassic-2 Ultra model. These tasks-specific APIs were created because they encapsulate frequently performed actions of many model consumers. The J2 models also support multiple languages for you out of the box.ĪI21 Labs has also created tasks-specific models such as Contextual-Answers, Paraphrase, Summarize, and Grammatical Error Corrections APIs which are tailor-made to carry out specific generative AI tasks. Let’s start by getting an understanding of what the Jurassic-2 series is J2 is a series of large language models created by AI21 Labs that offers multiple model sizes, and it includes foundation models in three different sizes: Ultra, Mid, and Light. It’s assumed you understand the following topics: AWS Lambda, Python, APIs, generative AI basics and terminology, and using generative AI APIs/SDKs. There’s a prerequisite set of skills we assume you have a grasp of to fully benefit from this post. There are many ways to deploy generative AI solutions on AWS, ranging from deploying an AWS foundation models using Amazon SageMaker JumpStart, to building and training your own models on AWS custom silicon chips or using a partner foundation model. Our goal in this post is to show what’s possible when it comes to building generative AI solutions on AWS. Businesses use AI21 Studio’s suite of solutions to build generative AI-driven solutions and drive innovation, unlock new capabilities, and scale existing initiatives. Founded in 2017, it was among the first companies to bring generative AI to the masses and, to date, offers enterprise solutions and consumer applications.ĪI21 Studio is AI21 Labs’ developer platform that provides API access to state-of-the-art LLMs, powering natural language comprehension and generation features in thousands of live applications and services. Before jumping into reviewing the code, we’ll first review the high-level architecture of the solution.ĪI21 Labs is an AWS Partner and AWS Marketplace Seller that’s a leader in generative AI and LLMs, revolutionizing the way people read and write. Additionally, we’ll make calls to the SDK from within a Lambda endpoint and pass back the results of the LLM as a JSON result.Īs part of this post, code will be included to deploy the solution in your own Amazon Web Services (AWS) account as a proof of concept (PoC) that you can expand further on. We’ll also discuss how to make calls to the J2 model via the publicly available Jurassic-2 Python SDK. This post walks through using the Jurassic-2 (J2) large language model and how to consume the model via an AWS Lambda API endpoint. As a result, they play an increasingly significant role in enhancing customer experience and boosting operational efficiency. ![]() They help solve for information overload and time constraints with capabilities to comprehend and produce human-like text. Generative AI and LLMs such as AI21 Labs’ Jurassic models are reshaping how we engage with information. ![]() The proliferation of these technologies presents an unparalleled opportunity for businesses seeking to leverage their vast capabilities. At the forefront of this revolution is generative AI and large language models (LLMs). The ever-evolving landscape of artificial intelligence (AI) has given rise to transformative solutions. By Sheldon Sides, Manager of Solutions Architecture – AWSīy Yuval Belfer, Developer Advocate – AI21 Labs ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |