I had a conversation with Ayomide Odumakinde (member of technical staff at Cohere AI labs) . We discussed artificial intelligence, the history of ideas in this field, current tools and methods, and what to expect in the years to come.
Links to things discussed/mentioned in this episode
Text Tokenization
https://www.ai21.com/knowledge/tokenization/
https://huggingface.co/learn/llm-course/en/chapter2/4
Scaling law papers
Reinforcement learning from human feedback (RLHF)
Learning to summarize with human feedback
Reinforcement Learning with Verifiable Rewards
Effective context engineering & context rot
Continual AI & learning
https://www.ibm.com/think/topics/continual-learning
Retrieval-augmented generation (RAG)
Function & tool calling with LLMs
Long-term memory in agentic systems
Follow us on:
Twitter @HintedNeuron
Instagram @hintedneuron
Facebook Hinted Neuron
Leave a review on this podcast at https://ratethispodcast.com/hintedneuron
Also, subscribe to our email list on our website https://hintedneuron.com to stay updated on new releases
Also, subscribe to our email list on our website https://hintedneuron.com to stay updated on new releases
