Contents x
    Pre-Built Templates
      • Print
      • Dark
        Light
      Contents

      Pre-Built Templates

        • Print
        • Dark
          Light
        Article Summary

        Two pre-built templates are currently available, Parse Formatted Numbers and Track Changes, with plans to add more pre-built templates.  

        Configuring Templates

        Templates are available, along with individual operators, in the Operator Library. Like individual operators, a short description is available on hover, providing an understanding of when you should use each template.

        Each template has its own default configuration. Detailed template documentation is available by selecting the Syntax: JSON information icon within the configuration panel.

        Since templates may be composed of multiple individual operators, double-selecting the template on the canvas expands the view and reveals each of the operators that make up the template.  

        While individual operators are not directly configurable, you can view the configuration by selecting any individual operator. 

        Parse Formatted Numbers

        The Parse Formatted Numbers template converts several string fields containing decimal numbers into numbers. An instance of this template should be used when the source data contains formatting that differs from standard English number formatting.

        This template supports the following options:
        • place_separator: string that separates groups of digits in the formatted number.
        • decimal_separator: string that separates the integer and fractional parts of the formatted number.
        • fields: array of fields to convert. Each field is configured using an object that has the following attributes:
        • from_field: name of the string field to convert to a number.
        • to_field: name of the numeric field in which to store the converted value.

        For example, we can convert two fields from the French numeric format (123.456.789,12345) using the following configuration:


        {
  "place_separator": ".",
  "decimal_separator": ",",
  "fields": [
    {
      "from_field": "Manually-Entered Weight 1",
      "to_field": "Weight 1"
    },
    {
      "from_field": "Manually-Entered Weight 2",
      "to_field": "Weight 2"
    }
  ]
}

        Track Changes

        The Track Changes template determines the current value for data sources where records are added but not deleted (instead of updating records in-place or deleting old records and adding new).

        This template supports the following options:
        • primary_key: array of field names. The logic that combines updates will merge together records that have identical values for all the fields in the array. For example, if primary_key is ["machine", "serial_no"] then records with machine="A" and serial_no="S" will not be combined with records having machine="A" and serial_no="T".
        • deleted_field: name of a boolean field indicating that the record was deleted. This field is automatically dropped after combining together updates.


        When combining updates, the most recent update wins. "Most recent" is judged by the timestamp field. If multiple updates can have the same timestamp, then the input stream must contain an appropriate timestamp_tiebreaker.


        What's Next