Formed in 2009, the Archive Team (not to be confused with the archive.org Archive-It Team) is a rogue archivist collective dedicated to saving copies of rapidly dying or deleted websites for the sake of history and digital heritage. The group is 100% composed of volunteers and interested parties, and has expanded into a large amount of related projects for saving online and digital history.
Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
Add pipeline element that warns if input is empty and/or add raise error/warn/info message on empty input [enhancement] #1213
Comments
|
You can capture the StreamSize from meta data using stroom:meta('StreamSize'). An approach would be to have a new pipeline that reads all Raw Event Streams, and raise a stroom:log() when the StreamSize is 0, you could output all the relevant meta into the message. You could also use this approach to warn of impending certificate expiry using stroom:meta('RemoteCertExpiry') |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
On occassion, an event source, if mis-configured, may send an empty file. It would have value if a pipeline element could exist that raises a configurable error, warning, etc if the given file is empty when processed (and then jump to the next file).
For example, the Stroom UI may aggreagte XML fragments and the 16th out of say 1000 files is empty. It would be good to identify this empty entry via processing metadata so one can investigate the sources.