Weekly updates from our team on topics like large-scale deep learning training, cloud GPU infrastructure, hyperparameter tuning, and more.
NOV 13, 2020
Slurm is a great HPC job scheduler but lacks key deep learning capabilities, such as hyperparameter tuning, distributed training, and experiment management.
NOV 10, 2020
How do Determined and Kubeflow compare? Determined is better for deep learning training, but Determined and Kubeflow can also be effectively used together.
NOV 05, 2020
Grad school would have been easier if we had access to Determined’s deep learning training platform.
OCT 08, 2020
Takeaways from our experience building state-of-the-art hyperparameter tuning in Determined AI’s integrated deep learning training platform.
OCT 07, 2020
Dramatically reduce the time to train GANs with Determined AI.
SEP 10, 2020
Learn how to do production-grade MLOps with scalable, automated machine learning training and deployment using Determined, Kubeflow Pipelines, and Seldon Core.
SEP 03, 2020
Training deep learning models for NLP tasks typically requires many hours or days to complete on a single GPU. In this post, we leverage Determined’s distributed training capability to reduce BERT for SQuAD model training time from hours to minutes, without sacrificing model accuracy.
AUG 11, 2020
How to build an end-to-end deep learning pipeline, including data preprocessing with Spark, versioned data storage with Delta Lake, distributed training with Determined, and batch inference with Spark.
AUG 05, 2020
A better approach to loading data for deep learning models.
JUL 30, 2020
We peek behind the curtain of TensorFlow Datasets to reveal some surprising problems.