User Tools

Site Tools


admin_functionality:create_session:step_2_set_attribute_groups

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
admin_functionality:create_session:step_2_set_attribute_groups [2018/07/17 08:35]
luke.swanton [Miscellaneous Features]
admin_functionality:create_session:step_2_set_attribute_groups [2021/03/04 20:15]
conor.doyle
Line 1: Line 1:
-====== Step 2 - Setting the Attribute Groups ======+====== Step 2 - Setting the Match Groups ====== 
 +---- 
 +===== Single Entity Configuration =====
 ---- ----
-===== Field Group Configuration ===== 
-==== Field Groups Column ==== 
-The Default Groups set in the settings menu will automatically be imported, but custom groups can be added by using  
-{{ :admin_functionality:create_session:step_2_5.png?nolink |}} 
-Or Alternatively Default groups from other Entities can be added using 
-{{ :admin_functionality:create_session:step_2_6.png?nolink |}} 
  
-**Note:** Groups and Attributes can be re-arranges by drag and droppinghowever this will be graphically only and will have no impact of the search.+As per the global setting appliedthe list groups will appear here. If needed, you can update this section for the current session.
  
 +{{ :admin_functionality:create_session:step2v3.png?800 |}}
 +
 +
 +**Note:** Any default grouping you have made in the settings menu will be imported. See the **[[admin_functionality:settings:set_attribute_groups| Match Groups Guide]]** for more detail.
 +
 +----
 +**Page Functions:**
 +
 +{{ :admin_functionality:create_session:functions.png?200 |}}
 +
 +  * **1. Expand All -** Expand all match groups
 +  * **2. Add Match Group -** Add existing match group or create a new group
 +  * **3. Delete -** Tag and then remove match groups
 +  * **4. Refresh -** Refresh to pre saved settings
 +
 +**Note:** Groups and attributes can be re-arranged by using the drag and drop function.
 +
 +----
 ==== Priority Column ==== ==== Priority Column ====
-By default, the priorities will appear as per the global settings. User can set/modify the 'Priority' for each group with the help of dropdown selection. 'Priority' is used to select the weighting for the match group. 'Priority' dropdown will have five values: 
  
-By Default the priorities will be the same as when set in the default creation, however these can be overridden using the dropdown. The available options are:+By default, the priorities will appear as per the global settings. You can set/modify the 'Priority' for each group with the help of drop-down selection. 'Priority' is used to select the weighting for the match group. 
 + 
 +{{ :admin_functionality:create_session:priority_column.png?800 |}} 
 + 
 +By default the priorities will be the same as when set in the default creation, however these can be overridden using the drop-down. The available options are: 
   * Exact   * Exact
   * Very High   * Very High
Line 22: Line 40:
 Priority is used to select a weight for the group in the match process. Priority is used to select a weight for the group in the match process.
  
-==== Match Key Column ==== +---- 
-This column is where you can specify which matching engine you want to use for each group.+==== Match vs Score ====
  
-There are currently 6 options available: +This section describes the difference between including groups for scoring vs including groups for scoring.
-  * DQ Fonetix (Recommended) +
-  * DQ Metaphone +
-  * DQ Soundex +
-  * Metaphone  +
-  * SoundEx +
-  * No MatchKey+
  
-==== Include For Matching Column ====+{{ :admin_functionality:create_session:include_for_matching.png?800 |}}
  
-Each group has a checkbox, if you disable matching for a group, it will not be used in the search for duplicates but will still be used to assess its overall duplicate score.+Include for matching - This will include match group, along with its attributes, in the matching process
  
-**Note:** at least one group must be included for matching+Do not include for matching - This will not feed the match group to the match engine, however once duplicate records are grouped, this data will be used for scoring records
  
 +E.g Email could be used for matching where sales@dqglobal.com returns multiple duplicate records. However when the data is scored with a score group 'Name' including the attributes 'First Name' & 'Last Name', the records will not score as duplicates upon scoring of these values. This setup would look like this:
  
 +{{ :admin_functionality:create_session:scoring_vs_matching_example.png?800 |}}
  
-===== Miscellaneous Features=====+---- 
 +===== Match Key =====
  
-This section is where you setup the groups that will be used for matching and scoring of duplicates.+You can set the ‘Match Key’ for each group with the help of drop-down selection. The 'Match Key' is used to select an algorithm for phonetic match token generation. The 'Match Key' drop-down will have six choices: 
 + 
 +==== Soundex ==== 
 + 
 +Soundex retains the first letter of the input string to formulate its match token. Soundex removes vowels (a, e, i, o, u) and h and w from the input string. The remaining letters are assigned numbers using a lookup table to produce a token of 4 characters. 
 + 
 +This means ‘Cathy’ and ‘Kathy’ will not match as their match tokens begin with a ‘C’ from Cathy and a ‘K’ from Kathy. As such, Soundex does not match well where the start of a word sounds the same but is not the same. 
 +Also, due to the numeric substitution it is possible to be shown non-matches (false positive) matches. 
 + 
 +{{ :admin_functionality:settings:kathy.png?nolink&600 |}} 
 + 
 +==== DQSoundex ==== 
 + 
 +DQSoundex overloads Soundex with the advanced capabilities of DQFonetix™. This improves the start of word logic and modifies the first letter(s) of an input string. DQSoundex will de-pluralise and pre-process the start of words to manage variances like ‘C’ to ‘K’ as in 'Cathy' and 'Kathy', as well as ‘Ph’ as in Phonetix to ‘F’ in Fonetix. 
 + 
 +==== Metaphone ==== 
 + 
 +Metaphone improves the Soundex algorithm by using information about variations and inconsistencies in English spelling and pronunciation, to produce a more accurate encoding. 
 +  
 +This allows you to find more precise matches than the simple Soundex algorithm. Metaphone considers a larger set of character transformations than Soundex and therefore analyses a string phonetically with far more accuracy.  
 +  
 + 
 +==== DQMetaphone ==== 
 + 
 +DQMetaphone like DQSoundex is an enhanced Metaphone technology with the advanced capabilities of DQFonetix™. This improves the start of word logic and modifies the first letter(s) of an input string. DQSoundex will de-pluralise and pre-process the start of words to manage variances and improve matching. 
 + 
 +In the case shown below (Christopher), Metaphone would have generated three of five names matches. However, after running DQ’s advanced algorithms and advanced logic, DQMetaphone allows ‘Kh’ from 'Khristopher' to match with the ‘Ch’ from 'Christopher'. Thus generating the same match key token.  
 + 
 +{{ :admin_functionality:settings:christopher.png?nolink&600 |}} 
 + 
 +==== DQFonetix™ ==== 
 + 
 +DQFonetix™ contains our advanced phonetic algorithms developed over the last 25 years by DQ Global. The algorithm is property DQ Global and hence we do not share the specification of the process. However, DQPhonetix™ has four key features: 
 + 
 +  * Five spoken languages – English, Spanish, French, Italian and German 
 +  * Avoids false matches 
 +  * Overcomes character variances  
 +  * Deals with diacritics 
 + 
 +DQPhonetix™ provides your CRM system with the most varied matching window to highlight duplicate matches that may not be picked up – or falsely matches - in Soundex and Metaphone. 
 + 
 +==== No Match Key ==== 
 + 
 +Selecting no match key will not generate a phonetic token, hence no match token will be generated. However, this allows you to match identical strings.  
 + 
 +**Include for Matching:** With the help of a checkbox feature, you can configure the ‘Include for Matching’ to select the attributes to be used for matching purposes. By default, the group is included for matching. You do have the option to uncheck the group and mark it as excluded. The groups which are not included for matching are still used for percentage scoring. 
 + 
 + 
 +---- 
 +===== Across Entity  Configuration ===== 
 + 
 +After you have selected your desired Entities from Step 1, you will be presented with a screen similar to this: 
 + 
 +{{ :admin_functionality:create_session:xentityv3.png?800 |}} 
 + 
 +To start the process you must first go through and assign your related fields from the entities: 
 + 
 +E.g. Address1_Country --> Address1_Country (as shown in the screenshot below) 
 + 
 +{{ :admin_functionality:create_session:cross_ent_step_2_2.png?nolink |}} 
 + 
 +**NOTE:** Attributes map have already been manually mapped on the [[admin_functionality:settings:map_entities| Across Entity Mapping Page.]] 
 + 
 +---- 
 +**Page Functions:** 
 + 
 +{{ :admin_functionality:create_session:functions.png?200 |}} 
 + 
 +  * **1. Expand All -** Expand all match groups 
 +  * **2. Add Match Group -** Add existing match group or create a new group 
 +  * **3. Delete -** Tag and then remove match groups 
 +  * **4. Refresh -** Refresh to pre saved settings 
 + 
 +**Note:** Groups and attributes can be re-arranged by using the drag and drop function. 
 + 
 +---- 
 +==== Priority Column ==== 
 + 
 +By default, the priorities will appear as per the global settings. You can set/modify the 'Priority' for each group with the help of drop-down selection. 'Priority' is used to select the weighting for the match group. 
 + 
 +{{ :admin_functionality:create_session:priority_cross_entity.png?800 |}} 
 + 
 +By default the priorities will be the same as when set in the default creation, however these can be overridden using the drop-down. The available options are: 
 + 
 +  * Exact 
 +  * Very High 
 +  * High 
 +  * Medium 
 +  * Normal 
 + 
 +Priority is used to select a weight for the group in the match process. 
 + 
 +---- 
 +===== Match Key ===== 
 + 
 +You can set the ‘Match Key’ for each group with the help of drop-down selection. The 'Match Key' is used to select an algorithm for phonetic match token generation. The 'Match Key' drop-down will have six choices: 
 + 
 +==== Soundex ==== 
 + 
 +Soundex retains the first letter of the input string to formulate its match token. Soundex removes vowels (a, e, i, o, u) and h and w from the input string. The remaining letters are assigned numbers using a lookup table to produce a token of 4 characters. 
 + 
 +This means ‘Cathy’ and ‘Kathy’ will not match as their match tokens begin with a ‘C’ from Cathy and a ‘K’ from Kathy. As such, Soundex does not match well where the start of a word sounds the same but is not the same. 
 +Also, due to the numeric substitution it is possible to be shown non-matches (false positive) matches. 
 + 
 +{{ :admin_functionality:settings:kathy.png?nolink&600 |}} 
 + 
 +==== DQSoundex ==== 
 + 
 +DQSoundex overloads Soundex with the advanced capabilities of DQFonetix™. This improves the start of word logic and modifies the first letter(s) of an input string. DQSoundex will de-pluralise and pre-process the start of words to manage variances like ‘C’ to ‘K’ as in 'Cathy' and 'Kathy', as well as ‘Ph’ as in Phonetix to ‘F’ in Fonetix. 
 + 
 +==== Metaphone ==== 
 + 
 +Metaphone improves the Soundex algorithm by using information about variations and inconsistencies in English spelling and pronunciation, to produce a more accurate encoding. 
 +  
 +This allows you to find more precise matches than the simple Soundex algorithm. Metaphone considers a larger set of character transformations than Soundex and therefore analyses a string phonetically with far more accuracy.  
 +  
 + 
 +==== DQMetaphone ==== 
 + 
 +DQMetaphone like DQSoundex is an enhanced Metaphone technology with the advanced capabilities of DQFonetix™. This improves the start of word logic and modifies the first letter(s) of an input string. DQSoundex will de-pluralise and pre-process the start of words to manage variances and improve matching. 
 + 
 +In the case shown below (Christopher), Metaphone would have generated three of five names matches. However, after running DQ’s advanced algorithms and advanced logic, DQMetaphone allows ‘Kh’ from 'Khristopher' to match with the ‘Ch’ from 'Christopher'. Thus generating the same match key token.  
 + 
 +{{ :admin_functionality:settings:christopher.png?nolink&600 |}} 
 + 
 +==== DQFonetix™ ==== 
 + 
 +DQFonetix™ contains our advanced phonetic algorithms developed over the last 25 years by DQ Global. The algorithm is property DQ Global and hence we do not share the specification of the process. However, DQPhonetix™ has four key features: 
 + 
 +  * Five spoken languages – English, Spanish, French, Italian and German 
 +  * Avoids false matches 
 +  * Overcomes character variances  
 +  * Deals with diacritics 
 + 
 +DQPhonetix™ provides your CRM system with the most varied matching window to highlight duplicate matches that may not be picked up – or falsely matches - in Soundex and Metaphone. 
 + 
 +==== No Match Key ==== 
 + 
 +Selecting no match key will not generate a phonetic token, hence no match token will be generated. However, this allows you to match identical strings.  
 + 
 +**Include for Matching:** With the help of a checkbox feature, you can configure the ‘Include for Matching’ to select the attributes to be used for matching purposes. By default, the group is included for matching. You do have the option to uncheck the group and mark it as excluded. The groups which are not included for matching are still used for percentage scoring. 
 + 
 +---- 
 + 
 +==== Include For Matching Column ==== 
 + 
 +Each group has a checkbox, if you disable matching for a group, it will not be used in the search for duplicates but will still be used to assess its overall duplicate score. 
 + 
 +**Note:** At least one group must be included for matching. 
 + 
 +----  
 +===== Miscellaneous Functions ===== 
 + 
 +This section allows you to setup the groups that will be used for matching and scoring of duplicates.
  
 You will see a screen similar to this:  You will see a screen similar to this: 
  
-**Note:** However this will vary depending on entity and what default groups you've setup.+**Note:** However this will vary depending on entity and the default groups you have setup.
  
-{{ :admin_functionality:create_session:step_2_1.png?nolink&600 |}}+**Matching Language:** When creating these groups you have the option to choose the matching language. The following can be used:
  
-**Matching Language:** When creating these groups you have the option to choose which language your fields are in. 
   * English   * English
   * French   * French
Line 58: Line 225:
   * Spanish   * Spanish
  
-This option is located : +This option is located:
-{{ :admin_functionality:create_session:step_2_2.png?nolink |}}+
  
-**Display Attributes by:** This is located just below the language dropdown, and allows you to filter the display names between the Database Schema Name and a user friendly Display Name.+{{ :admin_functionality:create_session:sprint26_step2_lang.png?nolink |}} 
 + 
 +**Display Attributes by:** This is located just below the language drop-down, and allows you to filter the display names between the database 'Schema Nameand a user friendly 'Display Name'. 
 + 
 +**Display Attributes Sorting:** The displayed attributes can also be sorted in:
  
-**Display Attributes Sorting:** The displayed Attributes can also be sorted in 
   * Ascending A-Z   * Ascending A-Z
   * Descending Z-A   * Descending Z-A
-This is done by using the Dropdown Menu available on the Entity Attribute Title. 
  
-{{ :admin_functionality:create_session:step_2_3.png?nolink |}}+This is done by using the drop-down menu available on the 'Entity Attributes' title.
  
-**Note:** On this same Menu under the "Columnsoption, you can also turn on or off the Attribute Icons and Title's.+{{ :admin_functionality:create_session:1016.png?nolink&600 |}} 
 + 
 +**Note:** On this same menu under the 'Columnsoption, you can also turn on or off the 'Attribute Iconsand title's.
  
 **Hover Actions:** **Hover Actions:**
-  * Hovering over an attribute in 'Display Name' mode will give a Tool-tip containing that Attributes Schema Name. And vice versa when in 'Schema Name' Mode+ 
-  * Hovering over an Attribute'Icon will give a Tool-tip containing the type of that Attribute.+  * Hovering over an attribute in 'Display Name' mode will give a tool-tip containing that attributes 'Schema Name' and vice versa when in 'Schema Name' mode
 +  * Hovering over an attribute'icon will give a tool-tip containing the type of that attribute.
  
 **Attribute Searching:** You can filter down the list of attributes by using the search icon: **Attribute Searching:** You can filter down the list of attributes by using the search icon:
-{{ :admin_functionality:create_session:step_2_4.png?nolink |}} 
  
-**Note:** You must search by title in the display mode you are in.+{{ :admin_functionality:create_session:1017.png?nolink&600 |}} 
 + 
 +**Note:** You must search by the title of the display mode you are in
 + 
 +---- 
 + 
 +**Expand/Collapse all:** This button will let you expand all folders or collapse all folders.
  
-**Expand / Retract all:** This button will let you expand all folders or retract all folders 
 {{ :admin_functionality:create_session:step_2_7.png?nolink |}} {{ :admin_functionality:create_session:step_2_7.png?nolink |}}
  
-**Delete Selected Item:** Pressing this button will delete the current selected item.+**Delete Selected Item:** Clicking this button will delete the current selected item. 
 {{ :admin_functionality:create_session:step_2_8.png?nolink |}} {{ :admin_functionality:create_session:step_2_8.png?nolink |}}
  
 **Refresh:** This will erase any changes you make a revert it make to the default. **Refresh:** This will erase any changes you make a revert it make to the default.
-{{ :admin_functionality:create_session:step_2_9.png?nolink |}} 
  
 +{{ :admin_functionality:create_session:step_2_9.png?nolink |}}
  
 **Back:** This will direct you back to step 1. **Back:** This will direct you back to step 1.
 +
 {{ :admin_functionality:create_session:step_4_2.png?nolink |}} {{ :admin_functionality:create_session:step_4_2.png?nolink |}}
  
 **Skip to Start:** This is only applicable to Cloned sessions. **Skip to Start:** This is only applicable to Cloned sessions.
 +
 {{ :admin_functionality:create_session:step_4_3.png?nolink |}} {{ :admin_functionality:create_session:step_4_3.png?nolink |}}
  
 **Next:** This will direct you to step 3. **Next:** This will direct you to step 3.
 +
 {{ :admin_functionality:create_session:step_4_4.png?nolink |}} {{ :admin_functionality:create_session:step_4_4.png?nolink |}}
 +
 +
 +
 +
admin_functionality/create_session/step_2_set_attribute_groups.txt · Last modified: 2021/03/04 20:17 by conor.doyle