Click any tag below to further narrow down your results
Links
The CNCF Technical Oversight Committee has approved KServe as an incubating project, recognizing its role as a scalable AI inference platform on Kubernetes. Originally developed under Kubeflow, KServe supports generative and predictive AI workloads and has seen broad adoption across various industries.
KServe v0.15 has been released, enhancing capabilities for serving generative AI models, including support for large language models (LLMs) and advanced caching mechanisms. Key features include integration with Envoy AI Gateway, multi-node inference, and autoscaling with KEDA, aimed at improving performance and scalability for AI workloads. The update also introduces a dedicated documentation section for generative AI and various performance optimizations.