Nick Gerakines will give a tutorial style example scripts to demonstrate some core concepts in tokenizing. This is a necessary first step if you want to train an LLM on your data. The examples are python based and use ollama to enable you to run your trained LLM offline.
The scripts can be found here: https://github.com/ngerakines/llm_fundamentals