Quickstart

General workflow in Orchest

  1. Build your pipeline. Visually build your pipeline: create, drag and connect steps.
  2. Write your code. Use your editor of choice or use the integrated JupyterLab environment in Orchest.
  3. Run your pipeline. Happy with your implementation? Go back to the pipeline view and run your pipeline.
  4. Check your output. This can be done either through the “logs” view or directly inside your notebook.

Your first project

We will go through an example project showing you how to build a pipeline in Orchest.

Launch Orchest:

./orchest.sh start

Build your pipeline. Create two steps and connect them.

https://user-images.githubusercontent.com/1309307/82610388-8ffc7580-9bbe-11ea-8886-d045ff6b76d0.gif

Directly edit your pipeline steps.

https://user-images.githubusercontent.com/1309307/82610397-94c12980-9bbe-11ea-8e16-eb686d0cfc75.gif

Run your pipeline and see the results come in.

https://user-images.githubusercontent.com/1309307/82610401-95f25680-9bbe-11ea-9de3-b4dc44a1e01b.gif