Welcome to the SKA SDP Rapthor Prefect Prototype documentation!

The SKA SDP Rapthor Prefect Prototype is a demonstration of how to use the Prefect workflow engine to orchestrate a basic self-calibration pipeline for radio astronomy data processing using Dask, WSClean and DP3. This is intended to be used as a starting point for exploring how the rapthor pipeline could be orchestrated using Prefect in the future.

This is currently at the proof-of-concept stage, and is a work in progress (see this Confluence page for more details)

• Quickstart
• Usage
  • How to run on a local machine
  • How to run on the AWS DP HPC cluster interactively
  • How to run on the AWS DP HPC cluster using SLURM