4.3.1. Start Small!

Complex pipelines and workflows can quickly increase the intricacy of your automation scripts.

• Starting with simple, toy-like pipelines allows you to experiment and learn without overwhelming complexity.

• Simplicity in workflow design is crucial; ensure it is as straightforward as possible.

  • Fewer dependencies lead to easier management and maintenance.

• Avoiding multiple sources of truth helps simplify management.

  • Parameterization (like dependency versions) should be defined in only one location, especially when used across multiple stages in a workflow or pipeline.

• Evaluating project structure before automation is essential.

  • Standard project setups for languages like Python, R, and Scala facilitate the use of automation functionalities, while custom structures may lead to complications.