Venkat's Blog – Medium

Venkat's Blog

Pinned

Essential Math & Concepts for LLM Inference

Back of the envelope calculations to estimate model’s GPU memory requirements & insights into HW/SW optimizations

May 31

Essential Math & Concepts for LLM Inference

May 31

Pinned

The power of Mechanical Sympathy in Software Engineering

Exploring Locality of Reference, LMAX Disruptor & Flash Attention

Apr 18

The power of Mechanical Sympathy in Software Engineering

Apr 18

Pinned

Published in
GoPenAI

CPU & GPU — The Basics

A digestible high-level overview of what happens in The Die

Apr 8

CPU & GPU — The Basics

Apr 8

IMHO, this is not the correct benchmark.

"The mean processing time is 286ms for Rust versus 436ms for Java." --> On the contrary, it proves how fast LMAX Disruptor is.

May 2

May 2

How Understanding CPU Caches Can Supercharge Your Code: 461% Faster MatMul Case Study

The power of Mechanical Sympathy in Software Engineering — Part 1

Apr 25

How Understanding CPU Caches Can Supercharge Your Code: 461% Faster MatMul Case Study

Apr 25

OS Error: Too many open files. Understanding file and socket descriptors.

Debugging resource leakage and optimizing server configuration

Mar 26

OS Error: Too many open files. Understanding file and socket descriptors.

Mar 26

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

It’s almost four months and it has been an amazing journey! At this point, I would like to thank my mentorsIsuru Ranawaka and Kasun…

Nov 13, 2022

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

Nov 13, 2022

HTTP Load Balancer performance test

In myprevious post, I discussed Load Balancer Engine Architecture and its features. In this post, I’ll be discussing on performance…

Nov 13, 2022

HTTP Load Balancer performance test

Nov 13, 2022

GSoC — Community Bonding Period

This year, the community bonding period was from April 22nd — May 22nd.. Though I was communicating with my mentor and community members…

Nov 13, 2022

Nov 13, 2022

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

It’s almost four months and it has been an amazing journey! At this point, I would like to thank my mentors Isuru Ranawaka and Kasun…

Nov 13, 2022

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

Nov 13, 2022

Venkat's Blog

Venkat's Blog

🧑‍💻 Staff Engineer – Distributed Systems, Machine Learning |📍Berlin 🇩🇪 | 📚 https://venkat.eu | 💬 https://twitter.com/Venkat2811

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams