LLM Archives - shbytes.com

Transformer Architecture – How Transformers Work

The Transformer is a more advanced architecture for neural networks. This was first introduced in 2017 article by Google, entitled "Attention is All You Need". Transformer architecture was designed to…

06.Neural Network Foundations

Introduction to Feedforward Neural Network – Comprehensive Tutorial

Artificial Neural Networks (ANNs) The introduction of Artificial Neural Networks (ANNs) into machine learning has been a game changer as they have proven to be effective tools for pattern recognition,…

05.LLM Text Preprocessing

Simplifying Lemmatization in Text Processing – Complete Tutorial (with Programs)

Introduction to Lemmatization in Text Processing Lemmatization in text processing is an important technique in natural language processing (NLP). Similar to stemming, lemmatization works to transform every word into its…

05.LLM Text Preprocessing

Understanding and Implementing Stemming in Text Processing

Introduction to Stemming in Text Processing Stemming is one of the critical text pre-processing technique in Natural Language Processing (NLP) and for Large Language Models (LLMs). Stemming refers to a…

05.LLM Text Preprocessing

Normalization in Text Preprocessing for LLMs – Complete Tutorial (with Programs)

Text Preprocessing for LLMs Preprocessing is an important step to make the raw text ready for the LLM models like ChatGPT and BERT, which take structured input to produce coherent…

04.LLM Embeddings

Understanding Sentence and Document Embeddings in NLP

What is Sentence and Document Embeddings Sentence and document embeddings are at the core of Natural Language Processing (NLP). These embeddings are represented in a close real-valued vectors format and…

04.LLM Embeddings

Understanding Static Word Embeddings in NLP – A Complete Guide

Static word embeddings is one of the approach to word representation in natural language processing (NLP). In this word embedding each word is represented as a single, fixed vector, independent…

03.Natural Language Processing

Natural Language Processing (NLP) – Comprehensive Guide

Natural Language Processing (NLP) is a technology in the artificial intelligence domain that involves interaction between human communication and machines understanding. It empowers machines to process human languages in a…

02.Language Models

Recurrent Neural Networks (RNNs) – Language Models

What are RNNs (Recurrent Neural Networks) Recurrent Neural Networks, or RNNs, are variants of artificial neural networks. They have been designed for processing sequential data. Other than the conventional feed-forward…

02.Language Models

What are N-Gram Models – Language Models

N-Gram Models N-Gram models are a fundamental type of language model in Natural Language Processing (NLP). These models predict the probability of a sequence of words with regard to the…