Brand New HPC Sysadmin at a Major University, Where to Start?

• Ansible

  391 61,210 9.8 Python

  Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate everything from code deployment to network configuration to cloud management, in a language that approaches plain English, using SSH, with no agents to install on remote systems. https://docs.ansible.com.

  

Ansible This is a very easy and popular solution but it scales horribly.

• spack

  52 3,969 10.0 Python

  A flexible package manager that supports multiple versions, configurations, platforms, and compilers.

  

Spack This is my go to for HPC software building and distribution. It designed specifically for HPC and Research applications. The included software library is very large and packaging new applications is fairly easy.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• slurm

  6 2,343 10.0 C

  Slurm: A Highly Scalable Workload Manager

  

SLURM (distributed by OpenHPC) If you have shared storage then this is the industry standard solution that is both open source and free (extremely popular in the top 500 list). You can pair this with a high speed network or not depending on your research workloads.

• prometheus

  382 52,843 9.9 Go

  The Prometheus monitoring system and time series database.

  

Prometheus + Grafana This tool combination is very popular and you decent integration with HPC schedulers such as SLURM.

• ohpc

  28 822 9.5 C

  OpenHPC Integration, Packaging, and Test Repo

  

SLURM (distributed by OpenHPC) If you have shared storage then this is the industry standard solution that is both open source and free (extremely popular in the top 500 list). You can pair this with a high speed network or not depending on your research workloads.

• Grafana

  379 60,503 10.0 TypeScript

  The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.

  

Prometheus + Grafana This tool combination is very popular and you decent integration with HPC schedulers such as SLURM.

Suggest a related project