AIOS

Get Started

LLM Services Available Directly from Generated Resources

AIOS provides an environment where LLM can be used immediately without separate LLM service installation or configuration, using resources created through Samsung Cloud Platform's Virtual Server, GPU Server, and Kubernetes Engine services. AIOS runs on Samsung Cloud Platform’s internal infrastructure, minimizing data leakage and providing private cloud-level security.

Overview

  • Conveniently Use of LLM

    AIOS provides LLM endpoints to Virtual Servers, GPU Servers, and nodes of Kubernetes Engine created in Samsung Cloud Platform. With GPU-based AIOS LLM, users can use LLM services immediately after resource deployment.

  • Improving AI Development Productivity

    AI developers can significantly improve the productivity and speed of AI application development by receiving APIs and SDKs based on Python and REST API, which are developer-friendly interfaces of AIOS.

  • Providing Various AIOS Models

    AIOS provides various AIOS models for LLM response generation, including natural language processing such as text generation, question answering, summarization, safety check of generated text, text similarity calculation or information retrieval, and re-ranking of search results or recommended items.

  • Efficient Cost Management

    AIOS can optimize cloud costs by using LLM resources when needed.

01

04

Service Architecture

User App.Dev [Conversational AI, Language Translation, Text / Code Generation, Text / Data Summarization] → Samsung Cloud Platform Samsung Cloud Platform
  • Virtual Server → AIOS
  • GPU Server → AIOS
  • Kubernetes Engine → AIOS
AIOS : AIOS LLM [Llama Family Model, Reasoning Model, Security Guard Model]

Key Features

  • Provide AIOS LLM endpoint
    1. Automatic provision of LLM private endpoint in the detailed inquiry screen of created Virtual Server, GPU Server, and Kubernetes Engine service resources
  • Provide visualized reports
    1. Can check the number of calls and token usage by service type, resource, and model
    2. View full call statistics by LLM model
  • AIOS compatibility
    1. Supports compatibility with OpenAI and LangChain SDK, allowing easy integration with existing development environments or frameworks

Let’s talk

Whether you’re looking for a specific business solution or just need some questions answered, we’re here to help

Get in Touch