A Linux Desktop in Jupyter LabJupyter is a useful environment for data exploration. Despite the many excellent visualization... Jan 20 26January 20, 2026Article at DEV Community
Remote Working and Camping: M4 MacBook Pro Power UsageA goal for 2026 is to camp more. I bought a National Parks Pass in December with the idea of extended... Jan 16 26January 16, 2026Article at DEV Community
Markitdown and Nebius AI Studio Vision ModelsMicrosoft released markitdown, a tool for converting files to Markdown such as PDFs, PowerPoint, Word, and Excel. In addition, it can perform audio transcription and image description and convert standard formats like HTML, CSV, JSON, and XML. Dec 16 24December 16, 2024Article at Linkedin
Txt-to-SQL: Querying Databases with Nebius AI Studio and Agents (part 3)Maximum effort! Not really. We're building an agent to query the database for this installment. We'll... Dec 13 24December 13, 2024Article at DEV Community
Text-to-SQL: Generating SQL with Nebius AI Studio (part 2)In the previous post, we created documents based on the tables in the Northwind Trader database. We... Tagged with nebius, text2sql, llm, generativeai. Dec 10 24December 10, 2024Article at DEV Community
Text-to-SQL: Creating Embeddings with Nebius AI StudioNebius AI Studio is an inference service offering state-of-the-art open-source large language models.... Tagged with nebius, rag, text2sql, llm. Dec 06 24December 06, 2024Article at DEV Community
Data Engineering with DLT and RESTBuilding a Data Pipeline with DLT In this example, a company provides IoT data through a... Dec 03 24December 03, 2024Article at DEV Community
SaSS-ify with Jigsaw StackJigsaw Stack's API provides various services, such as web scraping and LLM prompting. I tried out the... Dec 03 24December 03, 2024Article at DEV Community
A custom autocomplete model in 30 minutes using Unsloth (Community post)This is a guest post on the Continue Blog by Sophia Parafina, a developer advocate who has previously worked at Pulumi, Anaconda, and Docker. Continue is an open-source AI code assistant. It's a compound AI system that uses a set of models (chat, Oct 10 24October 10, 2024Article at blog.continue.dev
autollamaFrom the ollama help discord channel: Docker compose: How do you pull a model automatically with container creation? The conundrum of containerizing Ollama is that it must be running to pull a model. If you run ollama using docker compose, it doesn't… May 23 24May 23, 2024Article at DEV Community
RAG with Web SearchRetrieval augmented generation (RAG) is a popular way to use current or proprietary data with Large Language Models (LLMs). There are many articles describing how to perform RAG. Typically, they involve encoding data as vectors and storing the… Apr 29 24April 29, 2024Article at DEV Community
RAG Step-by-Step: Open Source EditionIn a previous post, I demonstrated how to implement RAG using the Load-Transform-Embed-Store workflow. I've updated the RAG Step-by-Step repository with an open-source example. Why open source? The most common reason for using open source versus a… Apr 05 24April 05, 2024Article at DEV Community
A RAG ClientIn the previous post, we went through the steps to build a backend for an RAG application. This is cool, but not being able to demonstrate it is no fun. The process for RAG is to retrieve data from the vector database and insert it into a prompt. To… Mar 27 24March 27, 2024Article at DEV Community
RAG Step-by-StepFrank Denneman of VMWare recently published RAG Architecture Deep Dive which defines the process for RAG applications. The article defines a Load-Transform-Embed-Store workflow. Let's implement the workflow in practice. For this tutorial, I'm using… Mar 25 24March 25, 2024Article at DEV Community
Build a GPU Enabled Llamafile ContainerIt's been fun playing with LLMs with a CPU. However, the novelty wears off as I watch the completion slowly display word by word. Enter the GPU, I have an older Ubuntu gaming laptop with a GPU I purchased for machine learning (I haven't played a game… Feb 06 24February 06, 2024Article at DEV Community
Building and Running llamafile with a GPUGetting llamafile running with a GPU can be a little tricky. For reference, I have a four-year-old Kubuntu laptop with a Nvidia RTX 2060. Check to see if the correct Nvidia driver is installed. nvida-smi If the driver is installed, you will see a… Jan 31 24January 31, 2024Article at DEV Community
A Quick Guide to Containerizing LlamafileLlamafile is a Mozilla project that runs open source Large Language Models such as Llama-2-7B, Mistral 7B, or any other models in the GGUF format. Containerize Llamafile The Dockerfile builds, containerizes llamafile, and runs it in server mode. It… Jan 15 24January 15, 2024Article at DEV Community
Local AILocal AI is the ability to run artificial intelligence models on commodity hardware. Many models can run on CPUs without a GPU, though a GPU is an advantage when running models. This means that anyone with a relatively recent computer build or a… Dec 22 23December 22, 2023Article at DEV Community
Installing Hugging Face on an M2 macOS MachineIf you are installing Hugging Face transformers on a M2 macOS machine, you might run into this error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [5 lines of output] Package sentencepiece was not found in the… Dec 18 23December 18, 2023Article at DEV Community
Connecting Lightsail to AWS ServicesThere are situations where you need access to AWS resources that are not in Lightsail, such as files on an EC2 server or the need to connect to an AWS RDS such as PostgreSQL or MariaDB. It is possible to use these resources via VPC (Virtual Private… Dec 07 23December 07, 2023Article at community.aws
