Skip to main content

Data Validation

Data validation refers to checking if data within your dataset, meet certain criteria. Validation often needs to be done on data that comes as text but represents something specific like number identifier, email, date, ip_address.

Check out the list of currently available validations and let us know if you could use some different ones on Slack 😊 or Github.

Date & Time#

valid_date_eu#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data meets european date format. (-./) allowed as separators.

=> select date_time, {{ re_data.valid_date_eu('date_time')}} as valid_date_eu
  date_time  | valid_date_eu------------+--------------- 31-01-2020 |          true 01/31/2020 |         false 05.05.2020 |          true

valid_date_us#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data meets us date format.

=> select date_time, {{ re_data.valid_date_us('date_time')}} as valid_date_us
  date_time  | valid_date_us------------+--------------- 31-01-2020 |         false 01/31/2020 |          true 05.05.2020 |          true

valid_date_inverse#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is in inversed date format.

=> select date_time, {{ re_data.valid_date_inverse('date_time')}} as valid_date_inverse
 date_time  | valid_date_inverse------------+-------------------- 31-01-2020 |              false 01/31/2020 |              false 05.05.2020 |              false 2020-01-31 |               true

valid_date_iso_8601#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid is time format.

=> select date_time, {{ re_data.valid_date_iso_8601('date_time')}} as valid_date_iso_8601
         date_time         | valid_date_iso_8601---------------------------+--------------------- 31-01-2020                |               false 2020-01-31T12:59:00+02:00 |                true 2020-01-31T12:59:00       |                true

valid_time_12h#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid 12h time (HH:MM) format.

=> select date_time, {{ re_data.valid_time_12h('date_time')}} as valid_time_12h
         date_time         | valid_time_12h---------------------------+---------------- 23:59                     |          false 12:59                     |           true 13:59:01                  |          false

valid_time_24h#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid 24h time (HH:MM) format.

=> select date_time, {{ re_data.valid_time_24h('date_time')}} as valid_time_24h
         date_time         | valid_time_24h---------------------------+---------------- 23:59                     |           true 12:59                     |           true 13:59:01                  |          false

valid_time#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid time, see examples:

=> select date_time, {{ re_data.valid_time('date_time')}} as valid_time
         date_time         | valid_time---------------------------+------------ 2020-01-31                |      false 23:59                     |       true 12:59                     |       true 13:59:01                  |       true 12:59:01,55               |       true 11:59:00                  |       true

Numbers#

valid_number#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid integer number.

=> select date_time, {{ re_data.valid_number('number')}} as is_number
    number    | is_number--------------+----------- 133          |      true 1232.232     |     false

is_number_decimal_point#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid number with deciaml point.

=> select date_time, {{ re_data.is_number_decimal_point_decimal_point('number')}} as is_number
    number    | is_number_decimal_point--------------+------------------------- 133          |                   false 1232.232     |                    true

valid_number_decimal_comma#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid number with deciaml comma.

=> select date_time, {{ re_data.valid_number_decimal_comma('number')}} as is_number_decimal_comma
    number    | is_number_decimal_comma--------------+------------------------- 133          |                   false 1232.232     |                   false 2332,123     |                    true

valid_number_percentage#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is in percentage format.

=> select date_time, {{ re_data.valid_number_percentage('number')}} as number_percentage
    number    | is_percentage--------------+--------------- 1,3%         |          true 123%         |          true 13  %        |         false 76.234%      |          true

valid_number_percentage_point#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data in percentage format (using point for decimals).

=> select date_time, {{ re_data.valid_number_percentage_point('number')}} as is_percentage_decimal_point
    number    | is_percentage_decimal_point--------------+----------------------------- 1,3%         |                       false 123%         |                        true 13  %        |                       false 76.234%      |                        true

valid_number_percentage_comma#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data in percentage format (using comma for decimals).

=> select date_time, {{ re_data.valid_number_percentage_comma('number')}} as is_percentage_decimal_comma
    number    | is_percentage_decimal_comma--------------+----------------------------- 1,3%         |                        true 123%         |                        true 13  %        |                       false 76.234%      |                       false

IP#

valid_ip_v4#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid ip_v4.

=> select ip_address, {{ re_data.valid_ip_v4('ip_address')}} as valid_ip_v4               ip_address               | valid_ip_v4----------------------------------------+------------- 1.2.3.4                                |        true 01.102.103.104                         |        true 124.171.228.4                          |        true 192.168.1.35                           |        true 01.1.1                                 |       false

valid_ip_v6#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid ip_v6.

=> select ip_address, {{ re_data.valid_ip_v6('ip_address')}} as valid_ip_v6               ip_address               | valid_ip_v6----------------------------------------+------------- 1.2.3.4                                |       false 2001:db8:3333:4444:5555:6666:7777:8888 |        true 2001:db8::                             |        true ::1234:5678                            |        true 2001:db8::1234:5678                    |        true ::11.22.33.44                          |        true 2001:db8::123.123.123.123              |        true 2001:db8::1234:5678:5.6.7.8            |        true 2001:db8:3333:4444:5555:6666:1.2.3.4   |        true ::11.22.33.44                          |        true 2001:db8::123.123.123.123              |        true ::1234:5678:91.123.4.56                |        true ::1234:5678:1.2.3.4                    |        true 2001:db8::1234:5678:5.6.7.8            |        true

valid_ip#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid ip either ipv4 or ipv6.

=> select ip_address, {{ re_data.valid_ip('ip_address')}} as valid_ip               ip_address               | valid_ip----------------------------------------+---------- 1.2.3.4                                |     true 232.232.33                             |    false 232.3232.232.232+2312                  |    false ::::erwerwe                            |    false 2001:db8:3333:4444:5555:6666:7777:8888 |     true

Email#

valid_email#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid email, using plus sign is not allowed (treated are error).

=> select email, {{ re_data.valid_email('email')}} as valid_email              email              | valid_email---------------------------------+------------- test@fakemail.com               |        true novalidemail@                   |       false novalidemail@com                |       false test+alovalidemail@fakemail.com |       false

UUID#

valid_uuid#

(source code)#

Arguments: column: The column to perform validation on.

Return type: boolean

This macro checks if data is valid universally unique identifier (UUID).

=> select uuid, {{ re_data.valid_uuid('uuid')}} as valid_uuid                 uuid                  | valid_uuid---------------------------------------+------------ ace1245c-3af5-11ec-8d3d-0242ac130003  |       true notanuid                              |      false d0d61836-3af5-11ec-8d3d-0242ac130003  |       true 343422-234324-234234-4234234-23432    |      false 343422-234324-234234-4234234-234xxx32 |      false

Your ideas#

If you have other suggestions of validations you would like to be supported (or you would like to add one), let us know on Slack! 😊