If you want to understand GPU for LLMs – why every AI company is spending billions on graphics cards to run large language models – the answer comes down to two things: parallel math and memory. This post explains both, without the handwaving. What is a CPU, and what’s it good at? A CPU – […]
If you arrived here from LinkedIn, this is the longer version of the story. If you have used a RAG system, you have witnessed the “it works sometimes” problem. A query returns the right answer on Tuesday and an unrelated paragraph on Wednesday. The fix is rarely a single change. It is a sequence of […]
Moving fast and breaking privacy Let’s be honest – the AI boom has blurred a lot of lines. The barrier to entry has never been lower, and people are building and shipping at incredible speeds. That’s not a bad thing in itself. But somewhere between the excitement and the hustle, privacy has quietly taken a […]
Motivation If you’re part of any enterprise that wants to use Large Language Models (LLMs) like ChatGPT, Mistral, Gemini etc., you know there is always some concern around exposing sensitive organizational data to these LLMs. Databricks acquired Mosaic AI in 2023 which helps tackle this exact problems – allows users to use any LLM without […]
How seamless is running a LLM-generated code? These days, everyone and their grandparents are talking about AI taking over human jobs. You cannot scroll through social media without seeing some CEO of a global conglomerate talking about how by 202x traditional programming jobs will be eaten up by AI agents. A new concept called Vibe […]
In this post, we will go over Vibe Coding and by the time we are done, we hope you will have a clear idea if Vibe Coding is right for your project. So what is Vibe Coding? Andrej Carpathy, one of the co-founders at OpenAI, came up with this phrase in one of his tweets, […]
Whether you’re developing front-ends in Angular, React or Vue, you need to follow a few simple rules to make it shine. More importantly, if there are no such rules, you’ll create a monster which will be a nightmare to maintain and scale. Here are the top five rules we follow at Mantrax. ✅ Do not over-engineer anything. […]
In this article, we will walk you through on how to use Visual Code Code (“VS Code”) to work on a remote machine such as a VM or a remote desktop. As developers, as we work through different projects, our computers keep getting filled with various SDKs, CLI tools, frameworks, and packages. Wouldn’t it be […]
With new AI tools coming up every now and then, each offering amazing benefits, data security is increasingly getting out of focus, and out of your control. As Canadian businesses, we are dealing with a lot of uncertainties and challenges amidst tariff threats from the United States. While operational efficiencies are important, we should not […]
In this article we will share how Mantrax is using Generative AI (when it makes sense) to improve productivity and deliver projects sooner. While we don’t want our developers to simply “ChatGPT” their way through projects, it is also undeniable that using Generative AI carefully can lead to productivity gains which in turn, deliver projects […]
