Blogs on 'llm' tag
-
Why Do Large Language Models Hallucinate and Why Model Weights Are Not Enough?
Understanding why LLMs hallucinate, the limitations of model weights, and why external knowledge retrieval is becoming essential for building more accurate and
-
How LLM Inference Works: From Prompt to Response
This blog is the detailed explanation of LLM inference pipeline from prompt to response.
-
Tokenization Techniques in Large Language Models (LLMs)
This blog is for implementation of tokenization and the different techniques for tokenization.
-
Memory Consumption During LLM Training
This blog is to provide the basic knowledge how the memory is use in LLMs
-
Implementing RoPE (Rotary Positional Embedding) in C#
This blog is the implementation of RoPE for understanding the basic mathematical calculation behind RoPE.
-
Positional Encoding and RoPE in LLMs
this blog will provide the concept of positional embedding and RoPE
-
Transformer Architecture in Large Language Models (LLMs)
This blog will give the knowledge about What is the transformer architecture and why its needed.
-
Self-Attention and Multi-Head Attention in Large Language Models (LLMs)
this blog will help you to understand about the Self- attention and multi-head attention in LLMs.
-
Understanding Word Embeddings and BERT with PyTorch
This blog explains embeddings and BERT contextual embeddings using PyTorch with similarity comparison examples.