Modern NVIDIA GPUs are feats of hierarchical design, optimized to maximize parallelism, minimize latency, and deliver staggering computational throughput. Building upon Part 1, which introduced the high-level architecture of NVIDIA GPUs, this is Part2 – a Deep dive into GPU Compute Hierarchy: Graphics Processing Clusters (GPCs), Texture Processing Clusters (TPCs), Streaming Multiprocessors (SMs), and CUDA…
Machine Learning
✅ Introduction to NVIDIA GPU Architecture: Hierarchy, Cores, and Parallelism
👋 Welcome to GPU Architecture 101 In this first post in five-part series, where I introduce you to the NVIDIA GPU architecture—a foundation for parallel computing used in gaming, scientific computing, artificial intelligence, and more. This guide is designed for engineering students and beginner developers who want to understand how modern GPUs work—from their evolution…
A Deep Dive into PyTorch’s GPU Memory Management
Here is an error I got when using an image generation deep learning model. It is a common error Engineers get when using PyTorch on GPU. To solve this error, a deep dive into PyTorch’s GPU Memory management is needed. So fasten your seat belts 🙂 torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 58.00…
🚀 The Evolution of YOLO 🚀
The YOLO (You Only Look Once) series is a real-time object detection algorithm that uses convolutional neural network (CNN). It has dramatically shaped the landscape of real-time computer vision. Each iteration of YOLO brings something unique to the table, enhancing the capabilities and applications of object detection. Let’s dive into the evolution of Yolo, details…
Basic Machine Learning Optimization Algorithms
Learn basic machine learning optimization algorithms. Explore Gradient Descent, and ADAM, which employs adaptive learning rates for each parameter.
Hand written notes on Neural Networks and ML course by Andrew Ng
About 2018 when I started working on Machine learning I took many courses. Here are my hand written notes on Neural Networks and ML course by Andrew Ng. It focuses on the fundamental concepts covered in the course, including Logistic Regression, Neural Networks, and Softmax Regression. Buckle up for some equations and diagrams! Part 1:…
Rust Programming Language learning roadmap
Rust is a multi-paradigm, general-purpose programming language exploding in popularity. But what makes it special? Rust offers a unique blend of blazing speed, unparalleled memory safety, and powerful abstractions, making it ideal for building high-performance, reliable systems. This blog delves into the Rust Programming Language learning roadmap Why Embrace Rust? Language Fundamentals: Understanding the Building…
What is Null and Alternative Hypothesis
A detailed description on the foundational but confusing topic of What is Null and Alternative Hypothesis
Supervised Machine Learning for Beginners
Hand written notes on Supervised Machine Learning