Quickstart

This is a quick start guide to get you up and running with the rapthor prefect prototype. We have provided a Dockerfile to make this as easy as possible. You will need to have Docker or podman installed on your machine.

  1. Open a terminal and navigate to the directory you want to clone the project.

  2. Clone the project repository using git.

git clone --recurse-submodules https://gitlab.com/ska-telescope/sdp/ska-sdp-rapthor-prefect-prototype.git
cd ska-sdp-rapthor-prefect-prototype

  1. Start a podman (or docker) machine if you don’t have one already. Ensure it has at least 12 GB of RAM allocated (required for compiling casacore).

  2. Build the container image using the provided Dockerfile.dev. This requires approximately 12 Gb of free disc space.

podman build -f Dockerfile.dev -t rpp

  1. Run the container, mounting the current directory to /src in the container. Ensure that the ports 4200 and 8787 are available on your machine. Port 4200 is for the Prefect UI and port 8787 is for the Dask dashboard.

podman run -it -p 4200:4200 -p 8787:8787 -v $(pwd):/src localhost/rpp

  1. The Prefect server will start automatically in the container. Wait for the Prefect UI to be available at http://localhost:4200. The code in poc.py will run automatically when the container starts. You can monitor the progress of the flow in the Prefect UI and the Dask dashboard at http://localhost:8787.