natural language processing Archives

joss-woodhead-3wFRlwS91yk-unsplash-scaled

Training a Tokenizer for Llama Model

John WalkerDecember 15, 2025

Training a Tokenizer for Llama Model enables the development of robust language generation capabilities. The...

mlm-olumide-3-feature-engineering-techniques-unstructured-data

3 Feature Engineering Techniques for Unstructured Text Data

John WalkerDecember 15, 2025

Making the most of natural language processing is crucial for machine learning models, and yet...

How LLMs Choose Their Words: A Practical Walk-Through of Logit…

John WalkerDecember 15, 2025

Llm Word Choice Strategies: Understanding Logits and Beyond When you ask a large language model...

https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd22cda3-d875-447e-b308-2f62c6ea733f_3206x2414

80% isn’t very good.

John WalkerDecember 10, 2025

80 Isn 8217 T. LLMs (like ChatGPT, Claude, Perplexity, or Grok) are reliable synthesizers, but...