ПРОЄКТУВАННЯ ТА АВТОМАТИЗАЦІЯ РОЗГОРТАННЯ ІНФРАСТРУКТУРИ КОРПОРАТИВНОГО ШІ-СЕРВІСУ НА ОСНОВІ ВЕЛИКИХ МОВНИХ МОДЕЛЕЙ
Abstract
Баландюк Антон Вікторович
студент групи МІПм-1-26-1.4 д.,
Київський столичний університет імені Бориса Грінченка, м. Київ,
науковий керівник — к.т.н., доц.Машкіна І.В.
Downloads
References
Kwon W., Li Z., Zhuang S. et al. Efficient Memory Management for Large Language Model Serving with PagedAttention. Proceedings of the 29th Symposium on Operating Systems Principles (SOSP ’23). 2023. DOI: 10.1145/3600006.3613165.
Autio C., Schwartz R., Dunietz J. et al. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. NIST AI 600-1. 2024. DOI: 10.6028/NIST.AI.600-1.
OWASP Foundation. OWASP Top 10 for LLM Applications 2025. OWASP GenAI Security Project.
HashiCorp. Terraform Documentation: Infrastructure as Code. HashiCorp Developer Documentation.
The Kubernetes Authors. Production Environment. Kubernetes Documentation.
The Kubernetes Authors. Schedule GPUs; Device Plugins. Kubernetes Documentation.
NVIDIA. NVIDIA Triton Inference Server Documentation.
KServe Project. KServe Documentation: LLM / Generative Inference.
Docker Inc. Docker Documentation: What is a Container?
Argo Project. Argo CD: Declarative GitOps Continuous Delivery for Kubernetes.
MLflow Project. MLflow Model Registry Documentation.
OpenTelemetry Authors. OpenTelemetry Documentation: Signals and Observability.
Prometheus Authors. Prometheus Documentation: Overview.
Abramov, V., Astafieva, M., Boiko, M., Bodnenko, D., Bushma, A., Vember, V., Hlushak, O., Zhyltsov, O., Ilich, L., Kobets, N., Kovaliuk, T., Kuchakovska, H., Lytvyn, O., Lytvyn, P., Mashkina, I., Morze, N., Nosenko, T., Proshkin, V., Radchenko, S., & Yaskevych, V. (2021). Theoretical and practical aspects of the use of mathematical methods and information technology in education and science. URL: https://doi.org/10.28925/9720213284km
