In this episode, the host Prateek Joshi talks about AI infrastructure ideas and categories including:
Model infrastructure:
- Compute hardware
- ML frameworks
- Foundation model providers
- Distributed model training
- Model deployment
- Building and serving verticalized models
- Streaming ML models
- Monitoring and logging
- Experimentation framework
- On-device applications
- Orchestration platform
- Latency
- User feedback loop
Data infrastructure:
- Storage hardware
- Data acquisition
- Databases
- Data labeling
- Cataloging product usage data
- Privacy and security
- Backup and redundancy systems
--------
Where to find Prateek Joshi:
Newsletter: https://prateekjoshi.substack.com
Website: https://prateekj.com
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19
Twitter: https://twitter.com/prateekvjoshi
