It is actually possible to filter by Niagara tag.
Filtering by Niagara Asset Tag is buried in “Other Filters”. However, its limited to using this filter to set a tag, rather than being able to pre-make a custom filter for specific tags.
If this filter is available, I would assume it should be possible to access Niagara Tags when writing custom filters but I don’t know what the syntax is.