ml-mate service helper trainer record experiment, dataset and performance

trainmate-sdk(ml-mate-py)
trainmate-fe(ml-mate-frontend)
trainmate-server(ml-mate-backend)

experiment: task + model

  • exp-id
  • exp-name # prefix dataset_name+model_name
  • dataset-id
  • desp

job: model+hyparamter+dataset

  • parent-id: exp-id
  • job-id
  • config(hyperparameter)
  • model_url
  • history # 用于画图
  • metrics # on trainset and valset
  • metric avg, std …..

dataset:

  • parent-id: task-id
  • dataset-id
  • desp # 描述
  • name # prefix=task_name
  • version # 版本
  • source
  • store_type

task:

  • task-id
  • desp
  • name

apis

job
  • create 一个exp中,job的name不能重复,如果重复则create失败
  • update 根据job-id/name+exp-id来更新
  • delete by job-id/name+exp-id
  • query by job-id/name+exp-id

GitHub

View Github