TimeWindower
Unbounded streams of data (eg. a Kafka Stream) are costly to store, have high data volumes, and will never finish loading, making it challenging to process and analyze. The TimeWindower transformer logically breaks up high-volume, unbounded data streams into groups using processing time (the time data arrives at TimeWindower) or event time (a timestamp on data representing the time an event happened). Once in groups, the data is ready for analysis and filtering.
TimeWindower can group high-volume data streams over short periods. For example, data incoming from a sensor at 2000 messages per second can be broken up into 30-second windows. Alternatively, TimeWindower can also group low-volume data streams over long periods, like data coming in at one message per second being windowed into 10-minute intervals.
Learn more about how to sort through raw, unbounded data streams in FME with Community tutorials like Getting Started with Stream Processing in FME, Filtering Unbounded Data Streams, Summarize Unbounded Data Streams, and Detecting Incidents in Unbounded Data Streams.
Learn More or Try FME For Free:
People Who Used This Transformer Also Used - See All Transformers
Related Resources
Windowing Data Streams in FME - FME Community
In FME, when processing data from a non-streaming data source (e.g. database or file), because the data is at rest and finite, you can load the data into memory ...
Introduction to Data Stream Processing
With the expansion of big data and analytics, organizations are looking to incorporate data streaming into their business processes to make real-time decisions ...
FME and Stream Processing
All data can be categorized as either bounded or unbounded. Bounded data is finite and has a discrete beginning and end. It is associated with batch processing …
Use the TimeWindower in FME
Download our fully-functional FME Desktop trial, free for 30 days. No credit card necessary. Start integrating!
