Innov-AI     Services     Supporters     Contact     About    
Data quality

Here you can check your data quality.

dq algorithm showdq algorithm setdq algorithm existdq algorithm getdq algorithm removedq generatedq analysedq analyse show

dq algorithm show


Description

    Show all algorithms

admin
dq algorithm show
mentdb
{<br> "is_null_or_empty": "\n\tis null or empty [VAR];\n",<br> "is_hour_without_sec": "\n\ttype is_hour_without_sec [VAR];\n",<br> "is_bool": "\n\ttype is_bool [VAR] 0 1;\n",<br> "is_integer": "\n\ttype is_integer [VAR] 8;\n",<br> "is_valid_timestamp": "\n\ttype is_valid_timestamp [VAR] \"yyyy-MM-dd HH:mm:ss\";\n",<br> "is_hour": "\n\ttype is_hour [VAR];\n",<br> "is_big_int": "\n\ttype is_big_int [VAR];\n",<br> "is_matches_regex": "\n\ttype is_matches_regex [VAR] \".*ze.*\";\n",<br> "COGNITIVE_french_word": "\n\tword exist [VAR] fr;\n",<br> "is_empty": "\n\tis empty [VAR];\n",<br> "is_time": "\n\ttype is_time [VAR];\n",<br> "is_char": "\n\ttype is_char [VAR] 25;\n",<br> "is_email": "\n\ttype is_email [VAR];\n",<br> "is_enum": "\n\ttype is_enum [VAR] \"1,2,3\";\n",<br> "is_decimal": "\n\ttype is_decimal [VAR] 4 5;\n",<br> "is_null": "\n\tis null [VAR];\n",<br> "is_double": "\n\ttype is_double [VAR];\n",<br> "is_byte": "\n\ttype is_byte [VAR];\n",<br> "is_varchar": "\n\ttype is_varchar [VAR] 15;\n",<br> "is_float": "\n\ttype is_float [VAR];\n",<br> "is_int": "\n\ttype is_int [VAR];\n",<br> "is_date": "\n\ttype is_valid_date [VAR] \"yyyy-MM-dd\";\n",<br> "is_small_int": "\n\ttype is_small_int [VAR];\n",<br> "is_medium_int": "\n\ttype is_medium_int [VAR];\n",<br> "is_number": "\n\ttype is_number [VAR];\n"<br>}

dq algorithm set <key> <mql>


Description

    Set an algorithm

Parameters

    key:   The key - string - required
    mql:   The MQL source code - string - required
admin
dq algorithm set "key" (mql { type is_char [VAR] 25; });
mentdb
1

dq algorithm exist <key>


Description

    Check if an algorithm already exist

Parameters

    key:   The key - string - required
admin
dq algorithm exist "key"
mentdb
1

dq algorithm get <key>


Description

    Get an algorithm

Parameters

    key:   The key - string - required
admin
dq algorithm get "key";
mentdb
<br> type is_char [VAR] 25;<br>

dq algorithm remove <key>


Description

    Remove an algorithm

Parameters

    key:   The key - string - required
admin
dq algorithm remove "key";
mentdb
1

dq generate <cmId> <tablename> <fieldname> <jsonArrayAlgoId> <sqlSource>


Description

    Generate the Data Quality MQL script

Parameters

    cmId:   The database connection id - string - required
    tablename:   The table name - string - required
    fieldname:   The field name - string - required
    jsonArrayAlgoId:   The json array with selected algorithms id - string - required
    sqlSource:   The select query (origin) - string - required
admin
dq generate "demo_cm_mysql" "products" "quantity" "[ \"is_big_int\", \"is_date\" ]" "select * from products limit 0, 500"
mentdb
json load "dq" "[]";<br><br>json load "dq_quantity" "{}";<br>json iobject "dq_quantity" / field "quantity" STR;<br>json iobject "dq_quantity" / algo "{}" OBJ;<br>json iobject "dq_quantity" /algo "is_big_int" (mql {<br> type is_big_int [T_quantity];<br>}) STR;<br>json iobject "dq_quantity" /algo "is_date" (mql {<br> type is_valid_date [T_quantity] "yyyy-MM-dd";<br>}) STR;<br>json iarray "dq" / (json doc "dq_quantity") OBJ;<br><br>dq analyse "demo_cm_mysql" (json doc "dq") "products" "select * from products limit 0, 500";

dq analyse <cmId> <jsonArrayAlgoId> <title> <sqlSource>


Description

    Make a data quality on a database

Parameters

    cmId:   The database connection id - string - required
    jsonArrayAlgoId:   The json array with selected algorithms id - string - required
    title:   The title - string - required
    sqlSource:   The select query (origin) - string - required
admin
json load "dq" "[]"; json load "dq_name" "{}"; json iobject "dq_name" / field "name" STR; json iobject "dq_name" / algo "{}" OBJ; json iobject "dq_name" /algo "is_float" (mql { type is_float [T_name]; }) STR; json iobject "dq_name" /algo "is_null" (mql { is null [T_name]; }) STR; json iobject "dq_name" /algo "is_small_int" (mql { type is_small_int [T_name]; }) STR; json iobject "dq_name" /algo "is_valid_timestamp" (mql { type is_valid_timestamp [T_name] "yyyy-MM-dd HH:mm:ss"; }) STR; json iarray "dq" / (json doc "dq_name") OBJ; dq analyse "demo_cm_mysql" (json doc "dq") "products" "SELECT * FROM `products` LIMIT 0, 500";
mentdb
In editor ...

dq analyse show <cmId> <jsonArrayAlgoId> <algoKey> <fieldKey> <title> <sqlSource>


Description

    Show an analyse

Parameters

    cmId:   The database connection id - string - required
    jsonArrayAlgoId:   The json array with selected algorithms id - string - required
    algoKey:   The algo key selected - string - required
    fieldKey:   The field key selected - string - required
    title:   The title - string - required
    sqlSource:   The select query (origin) - string - required
admin
json load "dq" "[]"; json load "dq_name" "{}"; json iobject "dq_name" / field "name" STR; json iobject "dq_name" / algo "{}" OBJ; json iobject "dq_name" /algo "is_float" (mql { type is_float [T_name]; }) STR; json iobject "dq_name" /algo "is_null" (mql { is null [T_name]; }) STR; json iobject "dq_name" /algo "is_small_int" (mql { type is_small_int [T_name]; }) STR; json iobject "dq_name" /algo "is_valid_timestamp" (mql { type is_valid_timestamp [T_name] "yyyy-MM-dd HH:mm:ss"; }) STR; json iarray "dq" / (json doc "dq_name") OBJ; dq analyse show "demo_cm_mysql" (json doc "dq") "is_float" "name" "products" "SELECT * FROM `products` LIMIT 0, 500";
mentdb
In editor ...




© 2012 - 2023