If you want to understand GPU for LLMs – why every AI company is spending billions on graphics cards to run large language models – the answer comes down to two things: parallel math and memory. This post explains both, without the handwaving. What is a CPU, and what’s it good at? A CPU – […]
If you arrived here from LinkedIn, this is the longer version of the story. If you have used a RAG system, you have witnessed the “it works sometimes” problem. A query returns the right answer on Tuesday and an unrelated paragraph on Wednesday. The fix is rarely a single change. It is a sequence of […]
Motivation If you’re part of any enterprise that wants to use Large Language Models (LLMs) like ChatGPT, Mistral, Gemini etc., you know there is always some concern around exposing sensitive organizational data to these LLMs. Databricks acquired Mosaic AI in 2023 which helps tackle this exact problems – allows users to use any LLM without […]
If you have read our online reviews and customer testimonials, you will notice a theme: we value transparency and candid conversations … even if it results in walking away from a project. That’s the kind of company we are. In this blog post, we will share our honest take on AI Adoption after working with […]
In this post, we will go over Vibe Coding and by the time we are done, we hope you will have a clear idea if Vibe Coding is right for your project. So what is Vibe Coding? Andrej Carpathy, one of the co-founders at OpenAI, came up with this phrase in one of his tweets, […]
Whether you’re developing front-ends in Angular, React or Vue, you need to follow a few simple rules to make it shine. More importantly, if there are no such rules, you’ll create a monster which will be a nightmare to maintain and scale. Here are the top five rules we follow at Mantrax. ✅ Do not over-engineer anything. […]
In this article, we will walk you through on how to use Visual Code Code (“VS Code”) to work on a remote machine such as a VM or a remote desktop. As developers, as we work through different projects, our computers keep getting filled with various SDKs, CLI tools, frameworks, and packages. Wouldn’t it be […]
With new AI tools coming up every now and then, each offering amazing benefits, data security is increasingly getting out of focus, and out of your control. As Canadian businesses, we are dealing with a lot of uncertainties and challenges amidst tariff threats from the United States. While operational efficiencies are important, we should not […]
In this article we will share how Mantrax is using Generative AI (when it makes sense) to improve productivity and deliver projects sooner. While we don’t want our developers to simply “ChatGPT” their way through projects, it is also undeniable that using Generative AI carefully can lead to productivity gains which in turn, deliver projects […]
In this post from our Byte Sized series, we will explore the subtle art of Prompt Engineering that has been gaining a lot of prominence in the realm of AI. The common analogy to describe Prompt Engineering is like teaching a child through asking questions. How effective your Large Language Model’s response is depends on the […]
