If you want to understand GPU for LLMs – why every AI company is spending billions on graphics cards to run large language models – the answer comes down to two things: parallel math and memory. This post explains both, without the handwaving. What is a CPU, and what’s it good at? A CPU – […]
If you arrived here from LinkedIn, this is the longer version of the story. If you have used a RAG system, you have witnessed the “it works sometimes” problem. A query returns the right answer on Tuesday and an unrelated paragraph on Wednesday. The fix is rarely a single change. It is a sequence of […]
Moving fast and breaking privacy Let’s be honest – the AI boom has blurred a lot of lines. The barrier to entry has never been lower, and people are building and shipping at incredible speeds. That’s not a bad thing in itself. But somewhere between the excitement and the hustle, privacy has quietly taken a […]
Motivation If you’re part of any enterprise that wants to use Large Language Models (LLMs) like ChatGPT, Mistral, Gemini etc., you know there is always some concern around exposing sensitive organizational data to these LLMs. Databricks acquired Mosaic AI in 2023 which helps tackle this exact problems – allows users to use any LLM without […]
In this article we will share how Mantrax is using Generative AI (when it makes sense) to improve productivity and deliver projects sooner. While we don’t want our developers to simply “ChatGPT” their way through projects, it is also undeniable that using Generative AI carefully can lead to productivity gains which in turn, deliver projects […]
In this post from our Byte Sized series, we will explore the subtle art of Prompt Engineering that has been gaining a lot of prominence in the realm of AI. The common analogy to describe Prompt Engineering is like teaching a child through asking questions. How effective your Large Language Model’s response is depends on the […]
In the ever-evolving landscape of artificial intelligence, Large Language Models (LLMs) stand out for their unprecedented language mastery, primarily attributed to their large parameter scale. However, LLMs are not without their challenges. This article delves into the intricacies of LLMs, exploring the pain points associated with their deployment and highlighting the role of data, ethical […]
In our ever-evolving technological landscape, the spotlight is on a revolutionary force—Large Language Models (LLMs). These digital wizards are rewriting the script of how we communicate with machines, ushering in a new era of possibilities. Getting to Know Large Language Models Large Language Models (LLMs) go beyond conventional computer programs, evolving into companions with fluency […]
