How LLMs Find Knowledge: From Tokens and Transformers to RAG
How text becomes tokens and vectors, what a Transformer actually does, why training is not RAG, and how to grow a Markdown knowledge base into retrieval.
Stuzhuk Lab — Chemistry of Code
Chemistry of Code
← All posts
Tag
Tutorial
All blog posts with this tag.
How LLMs Are Trained: Pretraining, Fine-Tuning, LoRA, RAG, and Agents
A practical map of LLM adaptation: what changes model weights, what plugs in knowledge and tools, and how to choose an approach without “fine-tuning on PDFs.”
From Junior to Senior Go Developer: What You Actually Need to Learn
A realistic Go growth map: the Junior foundation, Middle-level idioms and production work, then Senior architecture and responsibility—without needless frameworks or checklist theater.
Training a 6.4M-Parameter Transformer for Recipe Tasks
A developer built a compact PyTorch transformer from scratch, trained it for recipes, and runs it on CPU without external APIs.
How to Turn a Diagram Image into an Editable Diagram: Full Technology Survey from OCR to AI
Flowcharts, UML, BPMN, network topologies, and CAD drawings: why PNG ≠ diagram, what OCR, vectorization, CAD, computer vision, and VLMs deliver in 2025–2026, and which pipeline actually works.
Why Go became one of the most popular server-side languages
History of Go, simplicity philosophy, goroutines, cloud-native ecosystem, and comparison with Java, Node.js, Python, and Rust for backend engineers.
How the Modern Web Works: From Browser to Database
The full HTTP request journey — DNS, TLS, CDN, load balancer, Nginx, backend, Redis, queues, PostgreSQL, and back to the browser. A practical guide for developers and architects.
Evolution of Web Application Architecture Over the Last 20 Years
From server-side rendering in 2005 to AI apps and edge computing: how web architectures changed, why past choices were not mistakes, and how to pick an approach in 2026.
The smallest brain you can build: a perceptron in Python
One input, weight and bias, training epochs, and a linear decision boundary — neural network fundamentals without frameworks.
The frontend knowledge gap AI won't close for you
Rendering, networks, component architecture, and Core Web Vitals—what button tutorials skip and production demands.
10 facts about UX ROI: design is a business lever, not decoration
Speed, first impressions in ~50 ms, cost of fixes before launch — numbers from Smashing Magazine for talking to stakeholders.