Templates

Overview

Pipeline Templates are a management and scalability feature within the Pipeline Builder designed to organize complex streaming data transformations. While individual operators provide fine-grained control, large-scale pipelines can become difficult to navigate and maintain. Templates solve this by grouping multiple underlying operators into a single, reusable object. This modular approach allows users to centralize configurations and maintain a clean, readable canvas while leveraging either pre-built templates provided by Sight Machine or custom templates created for specific operational needs.

Feature Benefits

• Logic Reusability: Create a complex transformation logic once and deploy it across multiple sections of a pipeline or in different workspaces, ensuring consistency across data models.

• Centralized Configuration: Update parameters for multiple underlying operators from a single template interface, significantly reducing the time required for bulk adjustments.

• Enhanced Canvas Navigation: Simplifies the visual workspace by representing a sequence of operators as a single "block," making high-level pipeline structures easier to read and troubleshoot.

• Scalability at Ease: Enables the management of hundreds of data streams by utilizing templates to standardize common tasks like data cleaning, unit conversion, or shift scheduling.

• Pre-built & Custom Flexibility: Provides immediate value through Sight Machine’s library of pre-built templates while offering the flexibility to build unique, proprietary logic for specialized equipment.

Summary

Pipeline Templates transform the Pipeline Builder from a collection of individual tools into a scalable, enterprise-grade development environment. By abstracting the complexity of multiple operators into single, manageable objects, templates make pipelines significantly easier to navigate, maintain, and audit.

Whether you are implementing standardized pre-built templates to accelerate your time-to-value or developing custom templates to protect proprietary calculations, this feature ensures your data foundation remains organized and efficient as your digital transformation grows.

With Sight Machine you can use pre-built templates or create your own!