Integrations
Everything StreamPipes connects to.
36 adapters, 82 data processors and 29 data sinks come with the platform and install while it runs. This list is for the upcoming release. If something is missing, the SDK is there to build it.
147 extensions
Allen Bradley ETHThe adapter allows to connect devices supporting Allen Bradley ETH.
Apache IoTDBStores events in a IoTDB database.
Apache KafkaThe Apache Kafka protocol adapter enables StreamPipes to connect to Kafka brokers and consume messages. It provides: Real-time message consumption from Kafka topics Dynamic topic selection with runtime resolution Supp
Apache PulsarConsumes messages from an Apache Pulsar broker
Apache RocketMQConsumes messages from an Apache RocketMQ broker
Apache TubeMQ (InLong)Consumes messages from an Apache TubeMQ broker.
Beckhoff TwinCat ADSThe adapter allows to connect devices supporting Beckhoff TwinCat ADS.
Boolean CounterThe Boolean Counter processor counts state changes in a boolean field. It supports: Rising edge counting (FALSE -> TRUE) Falling edge counting (TRUE -> FALSE) Both edge counting Incremental counting State change det
Boolean FilterThe Boolean Filter processor filters events based on a boolean field value. It supports: Exact boolean value matching Event forwarding on match Simple true/false filtering State-based event filtering
Boolean InverterThe Boolean Inverter processor inverts the value of a boolean field in a data stream. It supports: Single field inversion TRUE to FALSE conversion FALSE to TRUE conversion In-place value modification Simple boolean 
Boolean Logical OperatorThe Boolean Logical Operator processor performs logical operations on multiple boolean fields. It supports: Standard logical operations (AND, OR, NOT, XOR, XNOR, NOR) Multiple input fields Single output field Truth t
Boolean TimerThe Boolean Timer processor measures the duration that a boolean field maintains a specific state. It supports: Measuring TRUE state duration Measuring FALSE state duration Multiple time units (milliseconds, seconds, 
Boolean To StateThe Boolean to State processor converts boolean fields into a descriptive state string. It supports: Multiple boolean inputs Custom state mapping Default state handling Runtime name mapping JSON configuration State
Buffered REST PublisherCollects a given amount of events into a JSON array. Once this event count is reached the JSON array is posted to the given REST interface.
Calculate DurationThe Calculate Duration processor computes the time difference between two timestamps. It supports: Time difference calculation Multiple time units Start/end timestamp selection Duration measurement
CANopenThe adapter allows to connect devices supporting CANopen.
Chunker (English)Segments given tokens into chunks (e.g. noun groups, verb groups, ...) and appends the found chunks to the stream.
ComposeThe Compose processor merges two event streams by combining their properties. It supports: Real-time event stream merging Last-event state tracking Custom output field selection Dynamic event composition Stateful ev
CouchDBStores events in an Apache CouchDB database.
Count ArrayThe Count Array processor counts the number of elements in array/list fields. It supports: Array size counting List length measurement Collection size tracking Dynamic array handling
Count Value OccurrenceThe Count Aggregation processor performs counting operations on event streams. It: Counts occurrences of values within a configurable time window Groups events by a specified field Provides real-time counting statisti
CSV Metadata EnricherThe CSV Metadata Enricher processor adds additional fields to events by looking up values in a CSV file. It supports: CSV file integration Field mapping ID-based lookups Multiple field enrichment Static metadata
DatasetStores events in the internal dataset so that data can be visualized in the live dashboard or in the data explorer. Simply create a pipeline with a dataset sink, switch to one of the data exploration tool and start explo
Datetime From StringThe Datetime From String processor converts string timestamps into millisecond timestamps. It supports: ISO 8601 format parsing Timezone handling String to millisecond conversion Automatic timezone application
Eclipse DittoForwards events to the Eclipse Ditto API.
Email NotificationThis sink sends an email to a specified receiver.
EthernetIPThe adapter allows to connect devices supporting EthernetIP.
Field HasherThe Field Hasher processor is a data transformation component that applies cryptographic hash functions to string values in a data stream. It can be used to encode sensitive information, generate unique identifiers, or t
Field MapperThe Field Mapper processor combines multiple fields into a single field by computing an MD5 hash value of their combined contents. This processor is particularly useful for:
Field RenamerThe Field Renamer processor changes the name of fields in events. It supports: Single field renaming Custom field names Runtime name modification Field name standardization
File StreamThe File Stream Adapter enables continuous streaming of file contents to Apache StreamPipes, creating a data stream for utilization within StreamPipes. It's particularly handy when you prefer not to connect directly to t
Generic CANThe adapter allows to connect devices supporting Generic CAN.
Generic Image ClassificationImage + Classification Description (Generic Model)
Geo Buffer GeometryCreates a buffer polygon geometry from a geometry
Geo Buffer PointCreates a buffer polygon geometry from a point geometry
Geo City Name Reverse DecoderThis processor computes city name based on given lat/lng coordinates that are transmitted as fields from an event. This processor automatically downloads the file cities1000.zip from <a href="http://download.geonames.org
Geo Create JTS PointThis processor creates a JTS Point geometry from latitude and longitude value.
Geo CRS ReprojectionChange of CRS due reprojection
Geo Distance Calculator (Haversine)Calculates the distance between two latitude/longitude pairs in a single event with the <a href="https://en.wikipedia.org/wiki/Haversineformula" target="blank">Haversine formula</a>.
Geo Distance Calculator Static (Haversine)Calculates the distance with the <a href="https://en.wikipedia.org/wiki/Haversineformula" target="blank">Haversine formula</a> between a fixed location (e.g., a place) and a latitude/longitude pair of an input event.
Geo EPSG CodeThis processor adds an integer value to the event. This integer value represents an <a href="https://en.wikipedia.org/wiki/EPSGGeodeticParameterDataset" target="blank">EPSG Code</a> as an Spatial Reference System Identif
Geo Geometry Topology Validation FilterValidates geometry of topology <a href="https://locationtech.github.io/jts/javadoc/org/locationtech/jts/operation/valid/TopologyValidationError.html" target="blank">erros from JTS</a>.
Geo Geometry Validation FilterChecks the geometry event if the geometry is simple and / or empty.
Geo Google Maps GeocoderThis processor computes the latitude and longitude values from a location (a place name such as "Karlsruhe, Germany ") and adds the result to the event.
Geo Google Maps Static GeocoderThis processor computes the latitude and longitude values from a fixed location (a place name such as "Karlsruhe , Germany ") and adds the result to the event.
Geo Single Trajectory CreatorThis processor creates a JTS LineString geometry from JTS Points events, represent a trajectory. A trajectory is defined as the path that a moving object follows through space as a function of time. Each sub-point of thi
Geo Speed CalculatorCalculates the speed (in km/h) based on latitude/longitude values in a data stream. Therefore, it uses the GPS and timestamps values of consecutive events. It calculates the distance between two points (events) and how m
HTTP ServerThis adapter provides an HTTP endpoint for ingesting events. Data sent to this endpoint via POST requests is transformed into StreamPipes events.
HTTP StreamContinuously fetched events from an HTTP REST endpoint.
IEC 60870-5-104The adapter allows to connect devices supporting IEC 60870-5-104.
Image CropperImage Enrichment: Crops an + image based on + given bounding box coordinates
Image EnricherImage Enrichment: Enriches an + image with + given bounding box coordinates
Image Upload (Stream)Upload a zip file of images and create an event per image
InfluxDBStores events in an InfluxDB.
InfluxDB Stream AdapterCreates a data stream for an InfluxDB measurement.
ISS LocationShows the live position of the International Space Station (ISS), updated every two seconds.
JavaScript EvalThe JavaScript Eval processor allows you to write custom JavaScript functions to transform and enrich events. It: Executes user-defined JavaScript code Provides full access to input event data Supports complex data tr
JMS PublisherPublishes events to a message broker (e.g., ActiveMQ) using the Java Message Service (JMS) protocol.
Kafka PublisherThe Kafka Publisher sink enables StreamPipes to publish events to Apache Kafka topics. It provides: Real-time event publishing to Kafka topics Support for various security configurations Support for multiple brokers 
KNXNet/IPThe adapter allows to connect devices supporting KNXNet/IP.
List CollectorThe List Collector processor aggregates values from a specified field into a list within a configurable batch window. It: Collects field values over time Creates a list of all values in the window Preserves original e
List FilterThe List Filter processor filters events based on the presence of a specific value in a list field. It: Checks if a value exists in a list Filters events based on list membership Preserves original event data Works w
Logix CIPThe adapter allows to connect devices supporting Logix CIP.
Machine Data SimulatorThis adapter publishes simulated machine sensor data at a configurable time interval. It is ideal for exploring the capabilities of StreamPipes without needing your own data or for testing purposes. Three different senso
MathThe Math Operation processor performs arithmetic calculations between two numerical fields in an event. It: Supports basic arithmetic operations (+, -, , /, %) Works with any numerical field type Preserves original ev
Math ExpressionThe Math Expression Evaluator processor allows you to perform mathematical calculations on numerical fields using the Apache Commons JEXL library. It: Evaluates mathematical expressions Supports complex calculations P
Measure Time Between Two SensorsThe Measure Time Between Two Sensors processor calculates the time difference between two boolean signals. It supports: Signal timing measurement Event sequence tracking Time difference calculation Signal counting M
Measurement Unit ConverterThe Measurement Unit Converter processor automatically converts values between different units of measurement. It supports any unit type that is compatible with the input field's measurement unit, including:
Merge stream with same schemaThe Merge By Schema processor combines events from two input streams that share the same event schema. It ensures data consistency by only merging events that have identical structures. This processor is essential for: 
Merge Two StreamsThe Merge By Enrich processor combines two event streams by enriching one stream with properties from the other. It supports: Real-time event stream enrichment Last-event state tracking Custom output field selection 
Microsoft SQL Server CDCThis adapter uses the embedded Debezium Engine to capture change events from a CDC-enabled Microsoft SQL Server table.
Microsoft SQL Server Table PollingThis adapter polls appended rows from one ordinary SQL Server table. It does not use Debezium and does not require Change Data Capture (CDC).
Milvusstores events in a Milvus database.
Modbus ASCIIThe adapter allows to connect devices supporting Modbus ASCII.
Modbus RTUThe adapter allows to connect devices supporting Modbus RTU.
Modbus TCPThe adapter allows to connect devices supporting Modbus TCP.
Moving AverageThe Moving Average processor smooths numerical data streams by calculating either the mean or median of the last n values. This processor is essential for: Reducing noise in sensor data Smoothing out fluctuations Iden
MQTTThe MQTT protocol adapter enables StreamPipes to consume messages from an MQTT broker. It provides: Real-time message consumption from MQTT topics Support for various authentication methods Configurable message handli
MQTT PublisherThe MQTT Publisher sink enables StreamPipes to publish events to MQTT topics. It provides: Real-time event publishing to MQTT topics Support for various authentication methods Configurable message handling Last Will 
MS Teams Sink---
Multi-Model Prompt ProcessorChoose between OpenAI, Anthropic or Ollama / Llama models and keep a stateless, windowed or full conversation when streaming events through StreamPipes.
Name FinderLoads a trained model which finds names like locations or organizations.
NATSConsumes events from a NATS broker.
NATS PublisherPublishes events to NATS broker.
Number LabelerThe Number Labeler processor adds labels to numerical values based on user-defined rules. It supports: Value-based labeling Custom rule definition Multiple conditions Default labels Value comparison
Numeric RoundingThe Number Rounder processor provides precise control over the decimal places in numerical data by applying various rounding strategies. This is essential for: Ensuring consistent precision across numerical data Reduci
Numerical FilterThe Numerical Filter processor filters events based on numerical comparisons with a specified threshold. It supports various comparison operations and is ideal for: Threshold-based event filtering Range-based data sele
Numerical Filter (Siddhi)The Numerical Filter processor filters numerical values based on a given threshold. Therefore, it uses the lightweight CEP engine Siddhi by issuing a Siddhi query, e.g.
Numerical Text FilterThe Numerical Text Filter processor combines numerical and text-based filtering in a single processor. It forwards events only when both the numerical and text conditions are satisfied. This processor is ideal for: Comp
OI4---
OneSignalThis sink sends a push message to the OneSignal application
OPC UAThis adapter reads node values from an OPC-UA server. The adapter supports both signed/encrypted and unencrypted communication.
OPC UA EventsThis adapter subscribes to OPC UA server events and emits read-only OPC UA event payloads.
OPC-UAThis data sink can be used to write values to an OPC-UA server. The sink supports both signed/encrypted and unencrypted communication.
parquetstores events in Parquet
Part of Speech (English)Takes in a stream of tokens and marks each token with a part-of-speech tag The list of used suffixes can be found here
PLC4X MODBUSThis adapter is deprecated since StreamPipes 0.99.0 and is planned for removal after the 0.99.0 release. Use the Modbus TCP adapter based on the generic PLC4X implementation instead.
PLC4X S7This adapter is deprecated since StreamPipes 0.99.0 and is planned for removal after the 0.99.0 release. Use the Siemens S7 (Basic) adapter instead. Existing adapter instances are automatically migrated, so no manual eff
PostgreSQLStores events in a Postgres database.
ProjectionThe Projection processor allows you to select a subset of fields from input events, creating a new event with only the specified fields. This processor is essential for: Reducing data volume Focusing on relevant fields
Pulsar PublisherPublishes events to Apache Pulsar.
QdrantStores events in a Qdrant vector database. This sink connector allows you to store vector data along with associated metadata in a Qdrant collection.
QR Code ReaderQR Code Reader: Detects a QR Code in an image
Quality Control Limits EnrichmentThe Quality Control Limits Enrichment processor appends user-defined control and warning limits to incoming events. These limits can be used in quality control charts to monitor sensor values.
RabbitMQ PublisherForwards events to a RabbitMQ broker
Rate LimitThe Rate Limit processor controls the frequency of events in a data stream by applying various windowing strategies. It supports: Time-based rate limiting Event count-based rate limiting Cron-based rate limiting Grou
RedisStores events in a Redis key-value store.
REST PublisherPosts a JSON representation of an event to a REST interface.
RocketMQ PublisherPublishes events to Apache RocketMQ.
ROS BridgeConnect Robots running on ROS
ROS Bridge SinkThis data sinks can publish events to ROS over websocket.
Sensor Limit AlertThe Sensor Limit Alert processor monitors sensor values in real-time and triggers alerts when these values exceed user-defined control or warning limits. This processor is useful in scenarios where continuous monitoring 
Sentence Detection (English)Detects sentences in a text and splits the text accordingly. Only works with english sentences.
Siemens S7 (Basic)The adapter allows to connect devices supporting Siemens S7 (Basic).
Signal Edge FilterThe Signal Edge Filter processor detects and forwards events when a boolean signal changes state (edge detection). It supports: Rising edge detection (FALSE -> TRUE) Falling edge detection (TRUE -> FALSE) Both edge de
Slack NotificationSlack bot to send notifications directly into your slack
SLMP (MELSEC) 3EThe adapter allows to connect devices supporting SLMP (MELSEC) 3E.
Split ArrayThe Split Array processor transforms array fields into multiple individual events, with each array element becoming a separate event. It supports: Array element extraction Context preservation Nested field handling C
Static MathThe Static Math Operation processor performs arithmetic calculations between a numerical field and a static value. It: Supports basic arithmetic operations (+, -, , /, %) Works with any numerical field type Uses a con
Static Metadata EnricherThe Static Metadata Enricher processor adds predefined metadata fields to events. It supports: Custom field addition Multiple data types (String, Boolean, Float, Integer) Field labeling Field descriptions Runtime na
String CounterThe String Counter processor counts changes in string field values. It supports: Value change detection Change pair tracking Incremental counting State transition monitoring
String TimerThe String Timer processor measures how long a string field maintains a specific value. It supports: String value monitoring Duration measurement Multiple time units Configurable output frequency
String To StateThe String To State processor transforms string properties into a list of state values. It supports: Multiple string inputs List-based state output Field value preservation State collection
Swinging Door Trending (SDT) Filter ProcessorThe Swinging Door Trending (SDT) algorithm is a linear trend compression algorithm. In essence, it replaces a series of continuous (timestamp, value) points with a straight line determined by the start and end points.
Switch Operator (Boolean Input)The Switch Operator (Boolean Input) is a StreamPipes data processor that allows you to route events based on the value of a selected boolean field. You can define multiple "switch cases," each with a specific boolean val
Switch Operator (Numerical Input)The Switch Operator (Numerical Input) is a StreamPipes data processor that allows you to route events based on the numerical value of a selected field. You can define multiple "switch cases," each with a numerical value,
Switch Operator (String Input)The Switch Operator (String Input) is a StreamPipes data processor that allows you to route events based on the value of a selected string field. You can define multiple "switch cases," each with a specific string value 
Synchronize Two StreamsThe Merge By Time processor combines events from two data streams based on their timestamps. It merges events when their timestamps fall within a specified time interval of each other. This processor is essential for: S
Task DurationThe Task Duration processor calculates the time duration between state changes in a task field. It supports: Task state tracking Duration calculation Multiple time units Process identification State transition timin
Telegram PublisherPublisher to send notifications to a Telegram channel.
Text FilterThe Text Filter processor filters events based on text field content. It allows you to: Match exact text strings Check for text containment Filter events based on text criteria Route events based on text content
Threshold DetectorThe Threshold Detector processor monitors numerical values and detects when they cross specified thresholds. It: Compares numerical values against a threshold Appends a boolean flag indicating threshold status Support
Throughput MonitorThe Throughput Monitor processor calculates and reports event processing throughput statistics. It: Measures event processing rates Tracks batch processing windows Calculates events per second Provides detailed timin
Timestamp ExtractorThe Timestamp Extractor processor breaks down a timestamp into its individual time components. It supports: Year extraction Month extraction Day extraction Hour extraction Minute extraction Second extraction Weekd
Tokenizer (English)Segments a given text into Tokens (usually words, numbers, punctuations, ...). Works best with english text.
Top kThe Top K Analysis processor collects incoming events in a configurable time window and outputs the top or bottom K events based on a specified count value. It: Aggregates events within a time window Ranks events by th
Transform to booleanThe Transform to Boolean processor converts string or number fields into boolean values. It supports: String to boolean conversion Number to boolean conversion Multiple field transformation In-place value modificatio
TrendThe Trend Analysis processor monitors numerical values and detects significant increases or decreases within a configurable time window. It: Detects percentage-based value changes Supports both increase and decrease de
Trigonometry FunctionsThe Trigonometry Functions processor performs trigonometric calculations on numerical values. It: Supports basic trigonometric functions (sin, cos, tan) Works with any numerical field type Preserves original event dat
tsfilestores events in TsFile
TubeMQ (InLong) PublisherPublishes events to Apache TubeMQ (InLong).
UMAS (Schneider Electric)The adapter allows to connect devices supporting UMAS (Schneider Electric).
Value ChangeThe Value Change processor detects specific transitions in numerical values. It: Monitors a selected numerical field Detects when the value changes from one specified value to another Adds a boolean flag indicating th
Value ChangedThe Value Changed processor detects changes in field values and outputs events only when changes occur. It supports: Any data type comparison Dimension-based state tracking Change timestamp tracking State size manage
Websocket ServerSend a message to a connected websocket client
Welford Change DetectionPerforms change detection on a single dimension of the incoming data stream. This implementation tracks the mean and the standard deviation using Welford's algorithm, which is well suited for data streams. A change is de
WinCC Alarm ArchiveThe WinCC Alarm Archive adapter reads Siemens WinCC alarm archives exported as CSV files.