![Red Hat OpenShift AI demo](https://house-fastly-signed-us-east-1-prod.brightcovecdn.com/image/v1/static/6415718971001/b630f232-6c63-49ce-a05a-debec59d863e/d7e14719-00c8-4c7d-841e-a37b7b72f0f9/1280x720/match/image.jpg?fastly_token=NjZkZDU1ZjJfNmVjM2MwN2NkNDc2MThkMzdjYmQ0YWQ3YzZjMmQ5MzcyNzliZDIzMWY2MjU5YTA5ZTQxNjZhMDI0NDZlODZjM19odHRwczovL2hvdXNlLWZhc3RseS1zaWduZWQtdXMtZWFzdC0xLXByb2QuYnJpZ2h0Y292ZWNkbi5jb20vaW1hZ2UvdjEvc3RhdGljLzY0MTU3MTg5NzEwMDEvYjYzMGYyMzItNmM2My00OWNlLWEwNWEtZGViZWM1OWQ4NjNlL2Q3ZTE0NzE5LTAwYzgtNGM3ZC04NDFlLWEzN2I3YjcyZjBmOS8xMjgweDcyMC9tYXRjaC9pbWFnZS5qcGc%3D)
Red Hat OpenShift AI demo
![Getting the most out of AI with open source and Kubernetes](https://house-fastly-signed-us-east-1-prod.brightcovecdn.com/image/v1/jit/6415718971001/c0d351c4-8896-4eb3-bedc-f35f66a53b94/main/1280x720/25m41s600ms/match/image.jpg?fastly_token=NjZkZDRlZGRfM2MxZjVjMTExZWY4YTJlZDM5NzIwYjE1MjM1MTUyNjQzN2Q4ZmI4MTg2NWI4YTFmYTdjZmQ0ZWY4YzY1ZjUyN19odHRwczovL2hvdXNlLWZhc3RseS1zaWduZWQtdXMtZWFzdC0xLXByb2QuYnJpZ2h0Y292ZWNkbi5jb20vaW1hZ2UvdjEvaml0LzY0MTU3MTg5NzEwMDEvYzBkMzUxYzQtODg5Ni00ZWIzLWJlZGMtZjM1ZjY2YTUzYjk0L21haW4vMTI4MHg3MjAvMjVtNDFzNjAwbXMvbWF0Y2gvaW1hZ2UuanBn)
Getting the most out of AI with open source and Kubernetes
![Deploying and maintaining Kubernetes across an air gap](https://house-fastly-signed-us-east-1-prod.brightcovecdn.com/image/v1/jit/6415718971001/941f2966-7110-4dfb-9dfd-9e1a80f83dae/main/1280x720/18m27s825ms/match/image.jpg?fastly_token=NjZkZDRhZTlfYWEzOThjZDI0ZGVjYmFmOTkyMWViYjJjZGQwMTRjYjgxNmNiZGUyN2U3OGY0NzZiNTBjZWM2NWZjZDUxMDg5YV9odHRwczovL2hvdXNlLWZhc3RseS1zaWduZWQtdXMtZWFzdC0xLXByb2QuYnJpZ2h0Y292ZWNkbi5jb20vaW1hZ2UvdjEvaml0LzY0MTU3MTg5NzEwMDEvOTQxZjI5NjYtNzExMC00ZGZiLTlkZmQtOWUxYTgwZjgzZGFlL21haW4vMTI4MHg3MjAvMThtMjdzODI1bXMvbWF0Y2gvaW1hZ2UuanBn)
Being able to quickly scale up or down OpenShift cluster resources becomes more critical as the fine-tuning of foundation models gains popularity. Red Hat and IBM Research have worked together to open source a generative AI infrastructure stack that has been provided in Open Data Hub and is being productized as part of OpenShift AI. In this demo, Mustafa Eyceoz shows how you can use Ray, CodeFlare, and Multi-Cluster App Dispatcher (MCAD) technology to prioritize real-time access to cluster resources or schedule workloads for batch processing.
Mustafa Eyceoz is a Machine Learning Engineer at Red Hat. Mustafa has worked on distributed model training for both OpenShift AI and RHEL AI, as well as inference performance and RAG solutions. He is currently working on the InstructLab project, as well as conducting research with IBM Research on Text2SQL, question decomposition, and LLM reasoning.