Platform

Data Quality & Observability

Detect anomalies anywhere in your data, in real time

Lineage

Get to the root cause and resolve issues quickly

Data Asset Insights

Discover data assets and understand how they are used

Discover the product for yourself

Take a tour
Pricing

Learn more

Customer stories

Hear why customers choose Validio

Blog

Data news and feature updates

Reports & guides

The latest whitepapers, reports and guides

Events & webinars

Upcoming events and webinars, and past recordings

Heroes of Data

Join Heroes of Data - by the data community, for the data community

Get help & Get started

OfferFit take their ML models to the next level with Validio

Read the case study
Product Updates

Introducing Segment Filtering: Effortless application of custom SQL rules across datasets

November 20, 2024
Emil BringEmil Bring

At Validio, we recognize the importance of zeroing in on data that matters most. As such, the segmentation feature in Validio’s anomaly detection quickly became a favorite among our users when we launched three years ago, and it remains a fundamental part of our platform today.

Simply put, segmentation hones in on the unique patterns and trends within your data, ensuring no detail, however minor, is overlooked. This lets you detect anomalies tied to small subsets of your data that would otherwise be manual and cumbersome (and extremely time-consuming) to find when you have large datasets with multiple columns and dimensions to monitor.

This is key because seemingly small data discrepancies can lead to big problems for your business.

Now, we’re launching Segment Filtering to make it even easier to use segmentation in your monitoring setup.

Segment Filtering is like a powerful WHERE clause for your data validation rules. 

Here's how it works:

1. Make custom SQL filters a breeze

Are you still rewriting things like

WHERE country IN ('Sweden, Norway, Denmark')

AND customer_group = 'Premium'

AND customer_id IS NOT NULL

every time you set up a custom SQL filter in a validator? 

Now, you can create, save, and reuse these filters across your data quality checks with just a few clicks.

null

No more copy-pasting conditions across different monitors.

Simply apply your saved filters anywhere you need them.

2. Zero in on the right segments: 

Want to monitor only high-value transactions or specific product categories? Instead of:

WHERE total_sales_amount > 1000 AND product_category = 'Electronics'

Just set these conditions once in your filter to save it. Then, swiftly apply it across any validators you want to zero in on vital data segments automatically.

3. Automatically keep your data clean: 

Just like you'd use:

WHERE timestamp >= DATEADD(day, -90, CURRENT_DATE)

to maintain relevant data, you can set up retention policies that automatically clean up outdated segments. Set it once, and we'll keep your monitoring focused on fresh, relevant data.

Like a spotlight for your data monitoring - see exactly what you need with our Segment Filters

Ready to try it? Book a demo and see how you can set up your first Segment Filter in less than minutes.

Try Validio for yourself to get

Automated Data Observability

Book a demo