LLM
some LLM’s model and weight are not opened to user
what is?
Llama 270b model
- 2 files
- parameters file
- parameter or weight of neural network
- parameter – 2bytes, float number
- code run parameters(inference)
- c or python, etc
- for c, 500 lines code without dependency to run
- self contained package(no network need)
- how to get parameters?
- lossy compress large chunk of text (10TB) with 6000 GPU for 12 days (cost 200$) to 140G zip file(gestalt of the text, weights and parameters)
- what neural do is trying to predict the next word in a sequence. parameters are dispersed throughout the neural network and neurons are connected to each other, fire in a certain way
- prediction has strong relationship with compression
- LLM create a correct form of text and fill it with its knowedge. not create a copy of text that was be trained.
- how does it work？
training stage
- pre-training
- expensive
- base model. get a document generator model
- it’s about knowledge
- internet documents
- fine tuning
- cheaper
- assistant model. get a assistant model
- it’s about alighment
- Q&A document
- training with high quality conversation(question and answer).write labeling instructions to specify how assistant should behave
- focus on quality not amount
- stage 3(optional)
- use comparison label
- reenforcement learning from human feedback
- labeling is a human-machine collaboration
- rank of LLM
LLM scaling laws：
- more D and N will get better model
- multimodality. now some LLM like GPT can use different tools to help it with answering questions. browser, calculator, python interpreter.
- future directions of development in LLM
give LLM system 2 ablility
- LLM now only have system one(instinctive)
- convert time to accuracy
self-improvement
- in narrow domain it is possible to self-improve
customization
experts in certain domain
future of LLM
