RawQ Topics

Overview

RawQ Topics are a critical component of the Sight Machine Platform, designed to ingest and process streams of data in real-time. This documentation provides a comprehensive guide on how to utilize RawQ Topics, including their purpose, and functionality.

What Are RawQ Topics?

RawQ Topics exist to facilitate the ingestion, processing, and management of data streams within the Sight Machine Platform. They act as conduits for data flowing from various sources into the platform, ensuring that data is organized and accessible for analysis and processing in the Pipeline

Key Functions of RawQ Topics:

• Data Ingestion: Collect data from multiple sources in real-time.

• Data Processing: Transform and prepare data for further analysis.

• Data Management: Organize and store data streams efficiently.

Using RawQ Topics

Accessing RawQ Topics

To access RawQ Topics, navigate to the Dev Panel, and click on the RawQ Topics tabs.

Viewing RawQ Topics

Filtering and Searching

• Filters: Use the filter options to narrow down your topics based on specific criteria. The URL parameters feature ensures your filters remain applied even if you navigate away from the page.

• Search: Quickly find specific topics using the search functionality. The search parameters are also preserved in the URL for easy bookmarking and future access.

• Reset: Click on the “Reset View” button to remove all existing filtering and search criteria currently applied.

Customizing Your View

• Choose Columns: Click on the "Visible Columns" option to customize which columns are displayed in your view. Select the most relevant columns to tailor your data presentation.

• New Columns: Utilize the new columns (Created Time, First Edge Arrival Timestamp, Last Edge Arrival Timestamp, First Data Time, Last Data Time) for enhanced data management.

Bulk Operations

• Bulk Selection:

  • Select as many topics as you want all at once by clicking on the “Selected” cell.

  • Use the “Select All Visible” option to select all on-screen topics at once. This is particularly useful for batch operations, saving time and effort.

• Bulk Deletion:  

  • After selecting multiple topics, you can delete them all in one action by clicking on the “Perform Action” button and selecting the “Delete Topics” option.

  • ⚠️ You are only allowed to delete topics that are not in use in a pipeline. To prevent accidental deletion, topics in use will be highlighted in red and the “Delete Topics” button will be disabled if you attempt to delete any of these topics.

• Bulk Merging and Sorting

  • After selecting multiple topics, you can merge and sort them all in one action by clicking on the “Perform Action” button and selecting the “Merge and Sort” option. This will generate a new topic that combines the data from all the selected topics.