MIT SuperCloud Documentation
Requesting an Account
Account Request Process
Why do we ask if you are using data that is not publicly available?
Generating ssh Keys for Supercloud Authentication
Adding your SSH Keys to your Account
Current Approver List
Getting Started
Logging in Via ssh
Shared HPC Clusters
Software and Packages
Linux Command Line
Transferring Files to MIT SuperCloud
Testing your Code
SuperCloud Downtimes
Systems and Software
MGHPCC TX-E1 Specifications
Available Languages
Modules
Software
Machine Learning Tools
Big Data Software Stack
Middleware Software Stack
Lincoln Laboratory Developed Software
Compilers
Using the Systetm
Files and Data
Transferring Files
Mac/Linux and Most Windows
Windows
Downloading Files through the Web Portal
Uploading and Downloading Files Using Jupyter
Shared Groups
Overview
Joining or Creating a Group
Using Shared Groups Effectively
Software and Package Management
Modules
Installing Software or Packages in your Home Directory
Julia Packages
Python Packages
R Libraries
Monitoring System and Job Status
Checking System Status
Monitoring Jobs
Stopping Jobs
Submitting Jobs
Submitting Jobs
How to start an Interactive Job with LLsub
Submitting a Simple Serial Batch Job
Requesting Additional Resources with sbatch
Requesting Additional Resources with LLsub
LLMapReduce
Matlab/Octave Tools
Triples Mode
Job Arrays with LLsub Triples in 3 Steps
Step 1: Batch Up your Array
Step 2: Changing Your Submission Script
Step 3: Submit your Job with LLsub Triples
Best Practices
Best Practices for Using the Filesystem
Installing Python Packages
Submitting Jobs
File Organization
Optimizing your GPU Jobs
Getting More out of the GPUs
Requesting More GPUs
Web Portal
Portal Authentication
MIT Touchstone/InCommon Federation
Username and Password
PKI Certificate/Smart Card
Adding/Removing SSH Keys
Browsing your Home Directory
Databases
Jupyter Notebooks
Starting Up Jupyter
The Jupyter Environment
A Note on Environment Variables and Modules
Frequently Asked Questions
How do I get an account?
I would like to log in from a new computer. Can I add a new ssh key?
How much storage do I have for my account?
How can I share files/code/data with my colleagues?
How do I set/change my password?
Are there any resource limits?
What do I do if my job won’t be deleted?
Why do I get an error when I try to install a package?
How can I set up VSCode to edit files remotely on Supercloud?
How can I use Tensorboard on Supercloud?
I got an Out of Memory error. How can I figure out how much memory my job needs and request more?
My Python/Julia job is running, but I don’t see any output in the log files. What is going on?
What does the Underutilizing/Oversubscribing the node warning message mean?
How can I get more help?
Getting Help
Additional Documentation:
Email:
Office Hours:
Online Courses
Some Available Online Courses
Accessing the LLx Online Course Site
Creating an Online Course Account
Questions?
Glossary
Acknowledging Us
MIT SuperCloud Documentation
Using the Systetm
Edit on GitHub
Using the Systetm
Files and Data
Transferring Files
Shared Groups
Software and Package Management
Monitoring System and Job Status
Submitting Jobs
Submitting Jobs
Job Arrays with LLsub Triples in 3 Steps
Best Practices
Best Practices for Using the Filesystem
Optimizing your GPU Jobs
Web Portal
Databases
Jupyter Notebooks