Getting Started

Getting Started

Install mlxserver via pip to get started. This installation will install mlx as well.

Install using PyPI

pip install mlxserver

To install from PyPI you must meet the following requirements:

  • Using an M series chip (Apple silicon)
  • Using a native Python >= 3.8
  • macOS >= 13.3


The following is an example of using Mistral 7B Nous Hermes 2 for generating text:


from mlxserver import MLXServer
server = MLXServer(model="mlx-community/Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX")


curl -X GET ''


This library only runs on Apple Metal. The MLX library focuses on Apple Metal acceleration.