Developers

Job files

A job file is a short list of what a job needs: the model or app, the hardware, the deadline, and where its data may live.

An example job

yaml
# A job, written as a short list of needs.
job: fine-tune-clinic-notes
model: open-model            # any open model
gpu: h100 x8                 # eight NVIDIA H100s
memory: 640gb
policy: patient-data         # the rules it follows
data_location: bangladesh    # stays in the country
max_price_per_hour: auto     # set by the policy
deadline: friday 18:00
on_change: move              # re-place on any change

Fields

FieldWhat it doesValue in the example
jobThe name of the jobfine-tune-clinic-notes
modelThe app or model to runopen-model: any open model
gpuThe kind and number of GPUs, or leave it to the Cloud Routerh100 x8
memoryThe memory the job needs640gb
policyThe policy the job followspatient-data
data_locationWhere the job's data must staybangladesh
max_price_per_hourThe most the job may cost per hourauto: set by the policy
deadlineWhen the job must finishfriday 18:00
on_changeWhat happens when price, capacity or location changesmove: re-place the job

Hardware you can name

NVIDIA H100, H200 and B200, AMD MI300X, and CPUs of every size. A job can name the hardware it needs or leave the choice to the Cloud Router, which checks what is free on each cloud before every placement.

Pin a job to a cloud

Pin a job to one cloud or one region and the Cloud Router keeps it there. You will rarely need to: with a policy and a location rule, the Router keeps every job where it is allowed to be, at the best price it can find.

How the job is placed

The Cloud Router filters by location and policy, checks live capacity, ranks by price, places the job and keeps watching. See The Cloud Router.

Was this page helpful?