HOME / SOFTWARE /

Sid G.9

June 28, 2019 

This is a limited first release that puts processes and infrastructure in place to support an expanded scope and an expanded, geographically dispersed team.

Work was concentrated in these areas:

  • Formal environments for Development, Testing, and Production
  • Reproducibility of instantiation of Development, Testing, and Production environments
  • Process for on-boarding additional team members
  • Formalized code management
  • Formalized release process
  • UI related issues
  • Addition and updating of supported applications

User facing Features of this release Include:

  • Unix desktop application with - Python( including Matplotlib, Numpy, Pandas) - R - Emacs (with Ista Zahn’s customizations) - LyX  - TexStudio 
  • Jupyter Notebook
  • RStudio
  • Application access to Harvard personal google drive mount
  • Support for Authentication and Authorization using HARVARDKEY and Grouper

 

Details of the Release:


Limitations:

  • Confidential data storage and processing are not supported. 
  • Users are limited to 10 running jobs each, with up to 4 CPUs and 7GB of RAM per job. If the cluster is full, jobs will remain in a "Pending" state until resources are freed. 
  • End user documentation is limited. 
  • There is no global mailing list for Sid users

Usability notes - Sid Job Launcher:

  • When launching a job, if an Application or Version has not yet been selected, then the "Connected storage" options are grayed out, and hovering the cursor over them changes it to a circle-with-slash-through, which indicates that the UI elements are disabled. However, clicking the grayed-out Google Drive option causes the Google authorization popup to open if Google Drive has not previously been authorized.
  • If timeout occurs between the the Dyno and Redis the Sid front end will have to be restarted. Running Jobs are not impacted.
  • Users may see: "This application has not been verified by Google" when attaching my Google storage." It's safe to move forward. 

Usability notes - Sid Desktop Application:

  • From a Mac, on Sid Desktop, the Command key will function as Control and the Control key will function as Meta (Alt). 
  • Logout or Quit from within an app will have undesirable results, such as rendering the job inaccessible. Don't do this.
  • When accessing the Sid Desktop over Chrome and Firefox, resizing the browser window does not resize the desktop window.
  • Up arrow not working in Sid Desktop Application from Mac. This has been observed in QTerminal and Emacs.
  • man command not found in Sid Desktop 
  • In the desktop, Ctrl+C/Ctrl+V/Ctrl+A/Ctrl+E key combinations for copy, paste, first letter of line, last letter of line, are switched.  
  • If you remove the Sid App authorization from your Google Account Settings, you will not be able to re-authorize the Sid App for access to your Google Drive. This can be fixed but requires administrator intervention.

Usability notes - Jupyter Application:

  • Quitting Jupyter causes a job to return to the "Initializing" status. It should be deleted instead, or moved to a "Terminated" status 

Maintenance and Upgrades:

Three of the four components of the system have been targeted for continuous deployment.  Updates to these components can be done outside of a maintenance window and will not impact running jobs:

  • FrontEnd 
  • Sid Middleware 
  • Applications. 

Updates to the BackEnd cannot be implemented in a continuous deployment scenario and impact all running jobs.  The Sid team reserves a weekly maintenance window from Monday at 5PM through Tuesday at 9AM during which BackEnd maintenance will occur.

Not every window will have activity and when possible, users will be given 24 hour notice prior to a maintenance window being utilized.  However, users should expect their applications to be terminated without warning during the maintenance period.