pixegami
pixegami
  • 68
  • 2 017 695
Deploy your RAG/AI App to AWS Cloud • Step-by-Step Tutorial
Learn how to deploy your Python RAG/AI project to the cloud in this advanced tutorial. We will turn the app into a public API, and host it on AWS Lambda (which makes it scalable and high-performance).
🔗 Code: github.com/pixegami/deploy-rag-to-aws
👉 Related Videos (in case you need it)
RAG Project Basic Tutorial: ua-cam.com/video/tcqEUSNCn8I/v-deo.html
RAG Project Advanced Tutorial: ua-cam.com/video/2TJxpyO3ei4/v-deo.html
FastAPI Tutorial: ua-cam.com/video/iWS9ogMPOI0/v-deo.html
Get Started with AWS: ua-cam.com/video/LFCTFzcMQuA/v-deo.html
AWS Bedrock (AI): ua-cam.com/video/kwkaBrK_-Bs/v-deo.html
Using Docker on Lambda: ua-cam.com/video/wbsbXfkv47A/v-deo.html
📚 Chapters
00:00 - Introduction
04:12 - RAG Recap
11:25 - Project Architecture
13:57 - Adding FastAPI
18:44 - Building a Docker Image
20:54 - Deployment Hacks
25:53 - Local Testing With Docker
29:17 - Build AWS Infrastructure with CDK
42:12 - Creating an Async API
54:11 - Wrapping Up
Переглядів: 2 415

Відео

Python RAG Tutorial (with Local LLMs): AI For Your PDFs
Переглядів 120 тис.2 місяці тому
Learn how to build a RAG (Retrieval Augmented Generation) app in Python that can let you query/chat with your PDFs using generative AI. This project contains some more advanced topics, like how to run RAG apps locally (with Ollama), how to update a vector DB with new items, how to use RAG with PDFs (or any other files), and how to test the quality of AI generated responses. 👉 Links 🔗 GitHub: gi...
Ollama: Run LLMs Locally On Your Computer (Fast and Easy)
Переглядів 11 тис.2 місяці тому
With Ollama, you can run local, open-source LLMs on your own computer easily and for free. This tutorial walks through how to install and use Ollama, how to access it via a local REST API, and how to use it in a Python app (using a client library like Langchain). 👉 Links 🔗 Ollama GitHub: github.com/ollama 🔗 LLM Library: ollama.com/library 🔗 RAG Langchain Python Project: ua-cam.com/video/tcqEUSN...
Using Python and AI to Automate My Video Editing Process
Переглядів 3,1 тис.2 місяці тому
This is a behind-the-scenes breakdown of my current process for making videos (as of 2024). In this video I'll show all the steps I take as I make these videos, the equipment I use, and some of the custom AI and automation tooling I've created to help make the process go faster (originally it was 1-2 months, now it's down to about 7 days). I use a lot of automation (with Python and AI tools) to...
Python Langchain Tutorial: Use 3 Different LLMs in 10 Mins
Переглядів 5 тис.5 місяців тому
Learn how to easily switch between LLMs in Langchain for your Python applications: OpenAI's GPT-4, Amazon Bedrock (Claude V2), and Google Gemini Pro. Or if none of these suit your needs, you can also implement your own interface. 📚 Chapters 00:00 Introduction 01:43 Getting Started 03:18 Creating the Base App 05:33 How To Use OpenAI GPT-4 07:42 How To Use Claude/Llama2 (via AWS) 09:33 How To Use...
Top 5 High Paying Tech Skills to Learn in 2024
Переглядів 13 тис.5 місяців тому
What are the top 5 tech skills to learn in 2024 to get ahead? In this video, I'll share what I think are the top 5 skills to invest time into this year if you want to get a high-paying role in tech, or to advance your career. This is based on various data and trends I've observed in 2023, and some of my own gut feeling. Salary Data: www.levels.fyi/ State of AI: www.mckinsey.com/capabilities/qua...
Create a Custom AI Assistant + API in 10 Mins
Переглядів 72 тис.5 місяців тому
Learn how to build your own AI assistant using OpenAI's Assistants API and how to access it via Python. 👉 Links 🔗 Code: github.com/pixegami/openai-assistants-api-demo 🔗 Documentation: platform.openai.com/docs/assistants/overview 🔗 OpenAI Assistants: platform.openai.com/assistants 🔗 Data (PDF): www.eiu.com/n/campaigns/global-liveability-index-2023/ 📚 Chapters 00:00 OpenAI Assistants API 00:58 Cr...
Build a Custom AI RPG Game with OpenAI GPTs
Переглядів 3,6 тис.6 місяців тому
Learn how to build custom OpenAI GPTs by making an interactive text-based adventure game (in the style of Dungeons and Dragons). 🔗 ChatGPT Custom GPT: chat.openai.com/gpts/discovery 🔗 OpenAI Assistants API: platform.openai.com/assistants 🔗 DnD "Wealthy Merchant" Campaign: www.dmsguild.com/product/194450/An-Introduction-to-DD The-Wealthy-Merchant 📚 Chapters 00:00 Introduction 01:06 Project Demo ...
Python Dataclasses: Here's 7 Ways It Will Improve Your Code
Переглядів 7 тис.6 місяців тому
Dataclasses in Python simplify the creation of data structures with minimal code, and gives you a lot of useful utility right out of the box. 🔗 docs.python.org/3/library/dataclasses.html 📚 Chapters 00:00 Introduction 00:25 What is a Dataclass? 01:06 Create Data Structures with Less Code 02:34 Descriptive REPR 03:30 Built-in Equality Check 04:11 Fields and Default Values 06:19 Frozen Objects 07:...
Streamlit: The Fastest Way To Build Python Apps?
Переглядів 71 тис.6 місяців тому
Learn how to build a Python Streamlit app in just 12 minutes! Streamlit turns data scripts into shareable web apps in minutes. All in pure Python. No front‑end experience required. 👉 Links 🔗 Code: github.com/pixegami/streamlit-demo-app 🔗 Streamlit: docs.streamlit.io/ 📚 Chapters 00:00 Introduction 00:41 What is Streamlit? 01:49 Using Input Elements 03:22 Working with Data 04:47 Multipage Apps 06...
RAG + Langchain Python Project: Easy AI/Chat For Your Docs
Переглядів 127 тис.7 місяців тому
Learn how to build a "retrieval augmented generation" (RAG) app with Langchain and OpenAI in Python. You can use this to create chat-bots for your documents, books or files. You can also use it to build rich, interactive AI applications that use your data as a source. 👉 Links 🔗 Code: github.com/pixegami/langchain-rag-tutorial 📄 (Sample Data) AWS Docs: github.com/awsdocs/aws-lambda-developer-gui...
Langchain: The BEST Library For Building AI Apps In Python?
Переглядів 3,9 тис.8 місяців тому
Learn to build LLM applications using Langchain (an AI toolkit for Python and JS). 👉 Links 🔗 Code: github.com/pixegami/basic-langchain-examples 🔗 Langchain: www.langchain.com/ 🔗 OpenAI Platform: platform.openai.com 📚 Chapters 00:00 Introduction to Langchain 00:52 Setting Up Langchain and OpenAI 02:36 Generate Predictions 03:40 Getting Structured Output 05:52 Sequential Chains 07:03 Building an ...
How to Publish a Python Package to PyPI (pip)
Переглядів 13 тис.8 місяців тому
Learn how to publish your own custom Python package to PyPI. This tutorial covers setting up the project, configuring the setup.py file, building and testing the package, adding CLI functionality, publishing to PyPI, and installing using pip. Watch this video if you want to share your code and make it easily installable for others. 📚 Chapters 00:00 Introduction 00:34 Project Setup 02:06 Configu...
Amazon Bedrock Tutorial: Generative AI on AWS
Переглядів 13 тис.8 місяців тому
Learn how to use Amazon Bedrock for generative AI (text and images) on AWS. This tutorial will guide you through the setup process, showing you how to generate text and images via code. You'll learn how to generate text with the Anthropic Claude model, and images with the Stable Diffusion model. All you need is an AWS account and the AWS CLI installed and configured. 🔗 Code: github.com/pixegami...
Python Requests Tutorial: HTTP Requests and Web Scraping
Переглядів 3,1 тис.8 місяців тому
Learn how to install and use "requests", one of Python's most popular module by downloads and adoption. This step-by-step guide covers installation, making HTTP GET/POST requests, handling errors and timeouts, and scraping data from websites. It is important for Python developers who want to integrate their applications with external services and retrieve data from websites. 👉 Links 🔗 Requests:...
How to Get Started with AWS • Crash Course
Переглядів 3 тис.8 місяців тому
How to Get Started with AWS • Crash Course
Pydantic Tutorial • Solving Python's Biggest Problem
Переглядів 244 тис.9 місяців тому
Pydantic Tutorial • Solving Python's Biggest Problem
Python FastAPI Tutorial: Build a REST API in 15 Minutes
Переглядів 43 тис.9 місяців тому
Python FastAPI Tutorial: Build a REST API in 15 Minutes
Host a Python Discord Bot on AWS Lambda (Free and Easy)
Переглядів 12 тис.9 місяців тому
Host a Python Discord Bot on AWS Lambda (Free and Easy)
My Custom MacOS Terminal Setup and Theme ✨
Переглядів 6 тис.9 місяців тому
My Custom MacOS Terminal Setup and Theme ✨
How to Run a Python Docker Image on AWS Lambda
Переглядів 26 тис.10 місяців тому
How to Run a Python Docker Image on AWS Lambda
How To Use GitHub Actions • Automate Your AWS Deployments
Переглядів 4,7 тис.10 місяців тому
How To Use GitHub Actions • Automate Your AWS Deployments
Stripe & Firebase Tutorial • Add Payments To Your NextJS App
Переглядів 17 тис.10 місяців тому
Stripe & Firebase Tutorial • Add Payments To Your NextJS App
Learn Python • #12 Final Project • Build an Expense Tracking App!
Переглядів 37 тис.Рік тому
Learn Python • #12 Final Project • Build an Expense Tracking App!
Learn Python • #11 Classes • Create and Use Classes in Python
Переглядів 2 тис.Рік тому
Learn Python • #11 Classes • Create and Use Classes in Python
Learn Python • #10 User Input • 4 Ways To Get Input From Your User
Переглядів 3,7 тис.Рік тому
Learn Python • #10 User Input • 4 Ways To Get Input From Your User
Learn Python • #9 Functions • Python's Most Important Concept?
Переглядів 1,1 тис.Рік тому
Learn Python • #9 Functions • Python's Most Important Concept?
Learn Python • #8 Tuples and Sets • More Ways To Store Data!
Переглядів 1,1 тис.Рік тому
Learn Python • #8 Tuples and Sets • More Ways To Store Data!
Learn Python • #7 Dictionaries • The Most Useful Data Structure?
Переглядів 1,3 тис.Рік тому
Learn Python • #7 Dictionaries • The Most Useful Data Structure?
Learn Python • #6 Loops • How to Repeat Code Execution
Переглядів 7 тис.Рік тому
Learn Python • #6 Loops • How to Repeat Code Execution

КОМЕНТАРІ

  • @super7ace
    @super7ace 7 годин тому

    I don't know how people would understand this if you are just giving an overview of concepts and not actually writing the code step by step.

  • @JavierTorres-st7gt
    @JavierTorres-st7gt 2 дні тому

    How to protect a company's information with this technology?

  • @tink417
    @tink417 2 дні тому

    am i missing something with respect to Chromadb. it is failing as it is asking for aws credentials.

  • @simdo01
    @simdo01 2 дні тому

    Well done Sir! :-)

  • @eillioniscreating
    @eillioniscreating 2 дні тому

    Really fantastic make more projects with python please

  • @anzakx
    @anzakx 3 дні тому

    Did something change with the deployment process. I am going through this and running into an issue where I get an error about an empty zip file but I did not see any steps about zipping the package.

  • @matthijszondervan7638
    @matthijszondervan7638 3 дні тому

    I had some fun with the code added multi threading to the pdf processing and tested a few collections of data. But i found out that the embedings are only good for English and not other languages. Any tips for that? Tried searching for embedings voor Dutch but not to many results.

  • @vdabhade
    @vdabhade 3 дні тому

    It's hard to find such high quality videos which is to the point with simplification in all the aspects. Great work !!!

  • @samvolzke1325
    @samvolzke1325 3 дні тому

    Hey, it does not work for me because i use a different package manager dnf (fedora). Anyone can help me?

  • @iamfine4891
    @iamfine4891 3 дні тому

    Love this channel, your content is clear explanation. Please do one video for fine tuning LLM for any specific task with one real-time use case

  • @saggitarius6155
    @saggitarius6155 4 дні тому

    Thanks a lot. That's what I've been looking for. I have one question, though. When you cd to some directory, the path to the directory shows above the profile name, but it's in a very faint grey? Is there a way to change that color? Thanks again.

  • @arishkhan7309
    @arishkhan7309 4 дні тому

    Can we get char location in this? or page number? like spacy gives location start character end character etc

  • @theodorostrochatos7247
    @theodorostrochatos7247 4 дні тому

    Great work! Thank you! Maybe a naive question, what should we change to make it work with LM studio instead?

  • @Rusputin-eo6tv
    @Rusputin-eo6tv 4 дні тому

    unit testing is such a silly way to test the answer, lol. We should ask another LLM to verify if it's a same thing =))))

  • @enricollen
    @enricollen 4 дні тому

    that's pure gold, ty!

  • @jh2000
    @jh2000 4 дні тому

    Hi!! Thanks for the video. Program works for document with chunks less than 90, but seems the Python code crashes whenever I try to store more than 90 chunks. Do you have any idea for this?? I can store around 80-90 chunks, if I try to add more, it crashes. Thanks!!!

  • @duongkhang4051
    @duongkhang4051 5 днів тому

    Great video❤❤. Can you show me how to write prompts please. Cuz my chatbot is educational and i want it can use the knowledge i provide to answer the abstract question

    • @duongkhang4051
      @duongkhang4051 5 днів тому

      For example i provide knowlegde about language that student can learn is French and Germany. So if i ask question about can student learn Spanish, i want chatbot answer no and provide the language that student can learn

  • @anzakx
    @anzakx 5 днів тому

    Is there a way to change the chunking to be by paragraph so you can reference a page number and paragraph?

  • @tarangsuri8932
    @tarangsuri8932 5 днів тому

    Great tutorial, Thanks!

  • @henkhbit5748
    @henkhbit5748 5 днів тому

    Thanks, it would be nice to answer question from a table or a picture in a pdf.

  • @PabloPuig-lz5wy
    @PabloPuig-lz5wy 6 днів тому

    Great tutorial! Im trying this out on a private server but the response time is very long. I currently have 23 CPU cores and 8Gb of ram. Is this enough? I also notice that not all cores are being used at the same time. Is there a way for all cores to be used?

  • @TimothyGarrett-mi9wm
    @TimothyGarrett-mi9wm 6 днів тому

    How is this any different than file explorer in windows?

    • @pixegami
      @pixegami 6 днів тому

      I’m not a Windows user so I’m not familiar with the file explorer, did they add RAG/AI capabilities? Anyway, the answer probably is this shows you how to build the capability yourself so you can (for example) make your own commercial product with it.

  • @srikanthj1733
    @srikanthj1733 6 днів тому

    Can i use this code in my web design and how do i integrate it to my react (maintain) project where i am doing it for my mini project

  • @chimoji608
    @chimoji608 6 днів тому

    I feel tupid because i stil don't understand the function calling and adding API and such 😅 I mean I'm not a programmer... that doesn't help :P

    • @chimoji608
      @chimoji608 6 днів тому

      so.. can you add an external API to the schema? And when you finish the assistant.. how do you then use the API for that assistant somewhere else? im going to watch those parts again haha

  • @DioneAl-Farisi
    @DioneAl-Farisi 6 днів тому

    I can't install twine

  • @mrash5997
    @mrash5997 7 днів тому

    This is my workflow dream, amazing stuff!!! I've listed out my entire workflow and slowly turning whatever I can into Python scripts. I suck at Python, but this is awesome motivation to learn. I'd love tutorials of your workflow. Whisper translation, auto edit code, ChatGPT, etc. I'm hoping to achieve similar results but with a local LLM (LLAMA 3) and DaVinci Resolves API. Have you ever tried Obsidian + Ollama? Curious! Thanks for the insanely good video, already watched several times.

  • @ubiquitousonegroup
    @ubiquitousonegroup 7 днів тому

    I have a question I would like to email it to you, I don't want to look bad in the comment section😗

  • @gigantwueste9633
    @gigantwueste9633 7 днів тому

    Why don't you use a WebSocket for communication with the ChatBot?

  • @SDChillRide
    @SDChillRide 8 днів тому

    Hi, not sure what is going on, but chromaDB take way too long to create my database. {'source': 'data\\EntityDiagrams_TR_v2014SE.pdf', 'page': 0, 'start_index': 0} Adding to Chroma DB... Number of existing documents in DB: 0 👉 Adding new documents: 261 Processing batch 1 with 100 chunks... Batch 1 added in 205.49 seconds. Processing batch 2 with 100 chunks... Batch 2 added in 204.37 seconds. Processing batch 3 with 61 chunks... Batch 3 added in 124.76 seconds. Documents added to Chroma DB in 535.19 seconds. Data store generated in 537.88 seconds.

  • @Niki-ue6fk
    @Niki-ue6fk 8 днів тому

    Thank you .

  • @johannanderson848
    @johannanderson848 8 днів тому

    I refreshed RAG completely for a presentation. This was unbelievable good and concise

  • @LavinOficial
    @LavinOficial 8 днів тому

    great video, direct and precise, I just want to ask you what happens if I want to give each user an ID, what would the logic be?

  • @user-js6qz2np1m
    @user-js6qz2np1m 9 днів тому

    Hats off 🎩

  • @srikanthdongala6922
    @srikanthdongala6922 9 днів тому

    I am trying to implement source CRUD in my application, but I am looking for an approach to embed docs where there is an update in the document, you he raised the question in the video butI would really like to listen to an approach to take here, creation and deletion is fine but what about the update? I don't want to embed the entire document Any responses will be very helpful, Thanks:)

  • @antoniobradley6259
    @antoniobradley6259 9 днів тому

    This is exactly what I needed. I was struggling with extracting the message from the message object group. This short 10 min video just solved a problem I was working on for 4 hours.

    • @pixegami
      @pixegami 9 днів тому

      That makes me really happy to hear, glad you solved your problem!

  • @aalamansari8643
    @aalamansari8643 9 днів тому

    can we use this to convert the data from pdfs to proper JSON format, if yes can u please tell the process and requirements for it. Would really appreciate it.

    • @pixegami
      @pixegami 9 днів тому

      Interesting idea. I don't know of a way to do it 100% reliably, but I'd probably start by defining the JSON schema you want to convert it to, then use an LLM to attempt the conversation, then write some code to validate the JSON's structure.

    • @aalamansari8643
      @aalamansari8643 9 днів тому

      @@pixegami what if the pdf consist of both tables and textual data? Then the JSON schema cannot be defined properly.

  • @anirbansom6682
    @anirbansom6682 10 днів тому

    How to create a CLI Command which will accept arguments ? Like, pixegami-hello --file_name /file/path/

    • @pixegami
      @pixegami 9 днів тому

      This is how you wire up scripts to command: python-packaging.readthedocs.io/en/latest/command-line-scripts.html If you want to parse arguments, use this built-in library: docs.python.org/3/library/argparse.html

  • @GregBreak
    @GregBreak 10 днів тому

    How can I add multi language support? So I can type in spanish and get response in the same language

  • @alphasauroxviix4235
    @alphasauroxviix4235 10 днів тому

    Thank you for putting so much effort into this video, the quality is just magnificent. Your channel is super underrated, I hope you get the recognition that you deserve soon.

    • @pixegami
      @pixegami 9 днів тому

      Thank you! Really glad to hear you enjoyed this :)

  • @ManuelJimenez1
    @ManuelJimenez1 10 днів тому

    Thanks for the whole tutorial, I would suggest adding speed at the queries of the vector database with PostgreSQL with pgvector, pg_embeddings plugin.

  • @pablomunsey
    @pablomunsey 10 днів тому

    Very well explained and done; detail information is provided, and the pace is perfect (considering I can pause and rewind). High quality. I've seen some of your other videos, and your talented at teaching!

  • @tomasemilio
    @tomasemilio 10 днів тому

    Your videos are awesome. I have also deployed my fastapi rag app, but i used AppRunner. it simplifes a lot of the stuff. I can use backgroundtasks from fastapi.

  • @subhodeepkayal4974
    @subhodeepkayal4974 10 днів тому

    How to change the color??

  • @maxflokinho
    @maxflokinho 10 днів тому

    I would like it not only to be able to read PDFs but also if the final information was 'weak' or missing information, it would do an internet search on the topic provided in the 'query' and complete the final answer with the collected data. Do you think this is feasible to do? I thought about using agents for this, like crewai. I looked but couldn't find any tutorial that used both methods.

  • @PavlosKoproutsidis
    @PavlosKoproutsidis 10 днів тому

    Hi there, What theme are you using?

  • @NIHITHRAJ
    @NIHITHRAJ 10 днів тому

    Awesome.. can you explain if the python code asks for excel input from the user, what modifications should be done?

  • @nagireddygajjela5430
    @nagireddygajjela5430 11 днів тому

    Wonderful presentation. Keep doing the same. Great job

  • @wacioc
    @wacioc 11 днів тому

    Considering the following example: Somewhere in chunk #3 there's the text: "Mark buys a tomato" Somewhere in chunk #261 there's the text: "Mark buys a grapefruit" Prompt: "What fruits did Mark buy?" I expect the answer to be something like: "Mark has bought a tomato and a grapefruit" Which chunk will it return as source?

  • @BellyLaughQuotes
    @BellyLaughQuotes 11 днів тому

    Is this approach work only in English ? What about other language ?