AHA Logo AWS Logo

WORKSPACE

About Workspaces

A workspace is a cloud-based compute cluster built on Hadoop/AWS EMR that you can interact with directly in your browser. Once registered for the AHA Precision Medicine Platform, you can provision a workspace from the My Workspace page. It will take approximately 1 hour before the My Workspace page will display a button that you can click to log into your workspace.

The AHA Precision Medicine Platform provides a friendly web UI that allows you to write code in various languages (for example, Python, R, Scala), execute the code, and view the results as they are processed.

The AHA Precision Medicine Platform UI is based around the concept of notebook files, where each notebook contains one or more code blocks (called cells). All of the content you write in your notebook is saved, even if you pause your workspace and come back to it later.

We have included Spark libraries for various languages (e.g. Pyspark, if you're writing Python code) to leverage the full parallel computing power of the Hadoop/AWS EMR platform. You can find examples and code snippets in the sample notebooks that are included on each workspace you provision.

Web Applications:

Application Introduction Version
Jupyter Notebooks The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and explanatory text. Uses include: data cleaning and transformation, numerical simulation, statistical modeling, machine learning and much more. v4.3
RStudio Coming soon

List of Jupyter Kernels:

We have the following kernels/languages that is pre-installed in the researcher workspace

Language Versions
Python 2.7.12
3.4.3
PySpark 2.0.2
R 3.3.2
SparkR -
Julia 0.5.0
Scala -
SQL -
Bash 4.2.46
iTorch 5.3.0

List of R and Python packages:

The following packages are available in the Production Workspace. We have installed the tools using standard automated methods. The implication being that the packages that are installed are the latest versions at the time of provisioning the workspace.

Python Packages
Machine Learning
  • scikit-learn - open source machine learning and visualization library
  • Theano - Efficiently evaluate mathematically expressions involving multi-dimensional arrays
  • Keras - Deep Learning library for Theano and TensorFlow
  • NiLearn - Machine Learning for Neuro Imaging in Python
  • TensorFlow - An open-source software library for Machine Intelligence
Scientific Computing
  • numpy - fundamental package for scientific computing using N-dimensional arrays
  • scipy - open source library of scientific computing
  • numexpr - fast numerical array expression evaluator
Data Analysis
  • Pandas - data analysis library
Statistics
Generic
  • ez_setup - installation helper library
  • boto3 - AWS SDK for Python
Visualization
  • ggplot - plotting system for Python based on R's ggplot2
  • Matplotlib - 2D plotting library
  • autovizwidget - An auto visualization library for pandas dataframe
R Packages
Generic
  • RJSONIO serialize R objects to JSON
  • itertools - Tools for creating iterators, based on Python equivalents
  • digest - a function to create hash of R objects
  • Rcpp - provides seamless integration between R and C++
  • functional - a higher-order functions library
  • httr - tools for working with URLs and HTTP
  • stringr - wrapper for common string operations
  • rJava - simple R-to-Java interface
  • DBI - for communication between R and RDBMS systems
  • devtools - tools to make Developing R packages easier
  • R.methodsS3 - methods that simplify the setup of S3 generic functions and methods
  • memoise - a method to cache the results of functions
  • rjson - converts R objects to JSON and vice versa
  • curl - - A modern and flexible web client for R
  • pbdZMQ - - interface to Zero MQ messaging system
  • uuid - tools for generating and handling UUID
  • htmltools - tools for html generation and output
  • repr - string and binary representations of objects
  • IRdisplay - interface to rich display capabilities of Jupyter frontend
  • evaluate - Parsing and Evaluation Tools that Provide More Details than the Default
  • crayon - Colored terminal output
Data Handling
  • Reshape2 - Flexibly restructure and aggregate data
Statistical Tools
  • caTools - basic statistical utility functions
  • fUnitRoots - environment for teaching "financial engineering and computational finance"
  • vars - collection of statistical functions
  • e1071 - misc functions from department of statistics, probability theory group
Visualisation
  • ggplot2 - create elegant and complex plots
  • shiny - web application framework for R
  • corrplot - graphical display of correlation matrix
  • plotly - graphing library makes interactive, publication-quality graphs online
  • ROCR - a visualization package
  • Shiny Dashboard - create web-based dashboards
  • rattle - A gnome based GUI for Data Mining
  • rpart.plot - plot 'rplot' models
Data Analysis
  • Hmisc - contains many data analysis functions
  • aod - functions to analyze over dispersed data
  • tseries - time series analysis and computational finance
  • markdown - turns analysis into high quality documents, reports
  • plyr - a set of tools to break down large problems into small manageable pieces
  • dplr - a set of tools to work with data frame like objects in-memory and out-of-memory
  • FSelector - Functions for selecting attributes from dataset
  • party - A computational toolbox for recursive partitioning
Machine Learning
  • randomForest - classification and regression library
  • arm - helper functions for regression
  • C50 - C5.0 decision trees and rule-based models for pattern recognition
  • DT - R Interface to DataTables library
  • ipred - Improved predictive models
  • caret - ML functions for regression and classification

Genomics and Bioinformatics Tools

Genomics / Bioinformatics Tools
ADAM Genomics Installed
SnpEff Genomics Installed
Picard Genomics Installed
SAMTools Genomics Installed
BWA Genomics Installed
Bioconductor Installed
BioPerl Coming soon
BioPython Coming soon
BioRuby Coming soon
BioJava Coming soon
Galaxy Coming soon
Hail Installed
PLINK Installed