User Tools

Site Tools


revision_history

Revision History


Version Date Release Notes
58.0 16th August 2021 Review Screen Optimisation DQ for Dynamics has now been modified to optimise the DQ Review screen load time. Whilst users process the current duplicate group, DQ for Dynamics is working in the background to load your next review group. This has been done to reduce load times and decrease overall review times.
57.0 16th July 2021 Opportunity Dedupe DQ for Dynamics has now been modified to Dedupe the standard Opportunity Entity. Please see @Opportunity Dedupe for More details.
56.0 14th May 2021 DQ Profiler Users can now profile their CRM Data from within DQ for Dynamics. Understand missing fields, row counts, non printing character. The Profiler is included in all DQ Foundation and Master modules. For more information please see DQ Profiler
55.0 15th April 2021 Related Entity Enhancements Changes have been made to surface the related entity data on the DQ Review screen and Auto-processes. These changes are as follows:
Related Entity Display An enhancement has been made to show related entity counts on the DQ Review Screen. Please see Related Entity Sessions in the Wiki.
Related Entity Group Rules Enhancement to the Display and Auto-fill rules. Users can now select apply group rules based off a related attribute. Eg. Make a decision of which address block to promote off of another attribute (Attribute where Last Verified = newest)
54.0 17th March 2021 Workbooks Integration DQ for Dynamics has now been integrated into Workbooks CRM. Users can now call the same powerful deduplicating and mastering functions from within Workbooks CRM. NOTE: The online wiki has been amended to support both DQ for Dynamics & DQ for Workbooks.
53.0 10th February 2021 Related Entity Matching Enhancement to the matching process. Users can now select related entity fields and use them in a matching criteria. Previously, users could only match off the Account, Contact or Lead Entities.
52.0 1st January 2021 Product Branding Perfect & Merge has been rebranded to DQ for Dynamics. After 5 years of development regarding duplicate detection and mastering, our attention is now turning to data cleansing and enrichment. Both in batch and at point of entry. The product will now fall into three categories:
Capture DQ for Dynamics™ Capture is built to provide everyday Dynamics 365 users with a powerful point of entry data capture solution. Ensuring data is consistent, complete, and unique upon entry.
Cleanse DQ for Dynamics™ Cleanse is developed to provide Dynamics 365 Admins with an easy-to-use bulk data cleansing tools and remove the tedious task of ongoing data cleansing. Bulk cleanse records through a set of pre-defined cleansing rules to deliver complete data consistency, data governance and data compliance across your ecosystem.
Consolidate DQ for Dynamics™ Consolidate is designed to help you tackle duplicate records when the out-of-the-box duplicate detection and merge tools just aren’t enough. Run match sessions to find duplicate records using fuzzy matching logic and a library of data transformations, then present groups of duplicates back to users for duplicate review. Quickly select your best record and seamlessly create a single customer view within your Dynamics 365 instance.
51.0 19th November 2020 Custom Transform Upload Enhancement to sort on the main session listings page. Users can now search for duplicate groups by reviewing status, reviewer, page number, group number.
Export Session Results Export session results from your match sessions. Define the export fields within the default settings and then export the match group results to a CSV.
50.0 24th September 2020 Page/Session Sorting Enhancement to sort on the main session listings page. Users can now search for duplicate groups by reviewing status, reviewer, page number, group number.
49.0 16th July 2020 Oauth Connection Enhancement to the Perfect & Merge provisioning process. Accounts can now be provisioned using Microsoft's Oauth connections protocol.
48.0 17th June 2020 Angular UI Release - V3 Release of Version 3 of Perfect & Merge. After 9 months of development, Perfect & Merge has now been developed with an Angular front end.
Atheistic Now designed in Angular, Perfect & Merge has been given a completely new look and feel. The whole application has undergone an overhaul, with a completely new look, feel and responsiveness.
Performance & User Experience Building in Angular has given the product & development team the flexibility to make major changes to features within the product. With the intent to reduce the complexity of the solution and make the application more intuitive. Major changes include: Default settings, review screen overhauled and UI Performance.
47.0 16th April 2020 Single/Cross Field Optimisation Due to feedback from clients, a change of name has been applied when matching across fields. Original: Intra Match/Inter Match. Replaced: Single Field/Cross Field. Full Info on this configuration can be seen on 'Step 1' of 'Create a Session'. There has also been a performance enhancement to the cross field matching engine.
46.0 5th March 2020 Status Reason A patch has been deployed to include non standard CRM status reasons. This allows user to apply custom status' when deactivating lead records. Standard status reasons include: Lost, Cannot Contact, No Longer Interested and Cancelled. Users can not add values to the status reason picklist of values and select them from within the Perfect & Merge UI.
45.0 5th February 2020 Advanced Find Perfect & Merge starts its transition to an Angular UI interface with the Advanced Find review screen. This is the first solution to be updated and released for Client use.
44.0 1st January 2020 Module Restructure With an increasing number of modules within the Perfect & Merge product stack, the decision was made to consolidate the modules into two offerings.
DQ Foundation Create match sessions to find duplicate records, review them in our advanced multi-record and create a single record view within D365.
DQ Master All Foundation features included. The DQ Master module allows users to schedule match sessions, automate the review of duplicates by automatically selecting your 'Best Record' from a set of duplicates, and then filling the best data from duplicate records. Then, once golden, automatically merge the duplicate records into the master record. For a full table of features, please view our website Features section: https://www.dqglobal.com/dq-for-dynamics-consolidate/
42.0 20th December 2019 Create & Link Module Release This feature is allows users to create a new golden record and then link other record from the duplicate group. This feature can be executed at group level, or in a bulk process.
42.0 23rd October 2019 Clone Session This feature allows users to clone an existing session and make tweaks to an existing configuration. This saves time and allows users the flexibility to make small changes.
41.0 25th September 2019 Multi Select Option Set This feature is enhances the linking functionality where users can now select the attribute to decide where the linking will be performed. Previously the user was unable to select the attribute for linking purposes. previously this had to be done by accessing the settings in web.config.
Auto Fill rules addition for lookup datatype: For lookup datatype there are now 3 new rules that can be applied:
1) Occurrences: search for most/least occurring value and accordingly apply a defined score.
2) Character length: Search for Longest/shortest length and apply a defined score.
3) Unique value populates empty field.
40.0 22 August 2019 Enhanced the record linking functionality We have now added the ability to choose which attribute is used when performing a link rather than a merge.

This can be found in Custom Settings > Basic Settings
39.0 26 July 2019 Audit Log UI Changes: Previously the Audit log had multiple columns to reflect the history of each and every change.
We have modified our solution and removed the 'loser value' column to make changes clearer.
Also, we have renamed some of the columns to make the change log easier to read.
i.e. instead of 'old value' we are using 'Original value' and instead of 'new value' using 'updated value'.

We have also changed what data is displayed inside the Audit log, Previously we were displaying change from only the duplicate records. In the revised version we are displaying changes from both the duplicate records and the master records.
Auto Fill rules addition for lookup datatype: For lookup datatype there are now 3 new rules that can be applied:
1) Occurrences: search for mos/least occurring value and accordingly apply a defined score.
2) Character length: search for Longest/shortest length and apply a defined score.
3) Unique value populates empty field
38.0 10 July 2019 UI Changes: Improved the UI for setting up Scoring Rules;
• Added a new column to the UI for the score inside a hierarchy screen for option set and Lookup fields. So you can now clearly see what will be the score against each value.

Improved the UI for viewing session Errors;
• Added a Link in the Session status screen to view any errors that scoured during the session
37.0 25 June 2019 Added support for Lookup Datatype: Lookup attribute support was added to enhance the existing functionality of Master record settings.
In this Enhancement we have added two new data types :
1. Lookup – applicable for all entities.
2. Customer – applicable for only Contact entity.

We have changed the working process for Owner data type.
This new data types will be considered for Master record selection. you can now add attributes of these datatypes and those will now be considered for Master record selection as well.
36.0 07 June 2019 Improved the Auto Fill Feature: We have added following new rules for String data type:
1. Equals
2. Contains
3. Begins With
4. Ends With
5. Contains Data
6. Default Value If Null
7. Hierarchy of Values
These rules can be applied at Global level as well as at Session level.
Improved Inactive Record Actions: In the Custom Settings Menu, you can now enable ‘Inactive Record Review’, this will enable it as an available option for all of your sessions.
When enabled, you will now be able to ‘Auto Fill’ and ‘Manual Fill’, however you will not be able to ‘Auto Promote’ or ‘Accept & Merge’ these records.

To use the Inactive Record Review feature in your session simply check the box


If enabled on a session;
Inactive records get considered for matching purpose but only auto fill operation will get performed.

If disabled on a session;
Inactive records will not be considered for matching purpose.
Enhanced Across Entity Merging: The Across Merge Feature was altered to give you the ability to choose which approach to take when dealing with matches, we have added the following options:
For Lead to account merging we are providing two approaches:
1. Link to Account
2. Link to Account, Merge & Deactivate
For Lead to account merging we are providing four approaches:
1. Link to Contact
2. Link to Contact, Merge & Deactivate
3. Link to Contact & Account of the Contact
4. Link to Contact & Account of the Contact, Merge, Deactivate
35.1 20 May 2019 Added functionality to Auto Promote: While creating sessions you can choose how the Master Record rules will be applied; sequential or scoring based.

In the Master record settings you can set different rules for different attributes. Here you can now add a score for each rule which will be used for detecting master record.
Added functionality to Auto Fill: While creating sessions you can choose how the Auto Fill rules will be applied; sequential or scoring based.

In the Auto Display & Fill settings you can set different rules for different attributes. Here you can now add a score for each rule which will be used for detecting what data should be moved to the master record.
35.0 11 April 2019 Added Functionality to Cross-Entity Matching: The Cross-Entity matching functionality has been reworked resulting in two ways of using the Cross-Entity module:
1. Across Entity: Compare records from 2 different entities (Account - > Contact)
2. Within Entity: Compare records from the entity using Views. This feature works by taking 1 record at a time from the Source View and looking into the Target View for possible duplicates.
34.0 09 April 2019 Added Possibility to Link Duplicates rather than Merge: This new feature will allow you to link the records from the group of duplicates rather than merge them, we have exposed this functionality both at session level and at group level.
This new functionality creates 2 additional options:
1. Auto Exact & Link
2. Auto Accept & Link

When the 'Auto Exact & Link' process is run, the duplicates which are Exact Matches as per the settings set globally in ‘Display & Auto Fill’ shall be ‘Auto Accepted’ and then ‘Auto Linked’.
Similarly, when Auto Accept & Link process run, all the duplicates from the group are ‘Auto Accepted’ and then ‘Auto Linked’.

This process, establishes the Parent-Child relationship between the Master and Duplicate Records. All the group duplicates whose status is ‘Auto Linked’ will be linked as Children with the Master.

Note: the ‘Auto Linked’ records will not be deactivated, they also won’t be merged with the Master.
Additional Scheduler Functionality: Added the following new actions to the Scheduler
1. Match - Auto Exact & Link All
2. Match - Auto Fill All - Auto Accept & Link All
3. Match - Auto Promote All - Auto Accept & Link All
4. Match - Auto Promote All - Auto Fill All - Auto Accept & Link All
Added Single Delimiter String Split Function: Added a new function in the ‘Attribute Group Transforms’ settings.
It will let you split a string based on a single delimiter of your choice (You also have the option to retain the delimiter)
33.0 08 March 2019 Added a new Post Merge module: Introduced a new feature which will allow you to add actions to be taken on the related entities after merging records.
Added a new Review: You can now review the records of your choice from CRM directly in the P&M Review screen without creating any session. You can review the multiple records (up to 10) from following CRM modules:
- Advance Find Results
- Account Records Listing
- Contact Records Listing
- Lead Records Listing
You just need to select the records (2 or more) and click on ‘P&M Review’ icon/button from the respective screen to view the selected records in P&M Review Screen.
You can take following actions on the selected group of records:
- Auto Promote
- Auto Fill
- Exact & Merge
- Accept & Merge
- Manual Promote
- Manual Fill
Added Auto Fill Rules for Owner Attribute: You can now add the Auto Fill Rule at Attribute Level on ‘Owner’ attribute.
Restriction to Auto Filling of NULL Values: Added restriction to filling the NULL values in Master from the Winner Groups as per Auto Fill Rules.
Can now view any session errors in the session details: You can view the details of exceptions encountered during the Auto Processes in the session detail module in the respective process section.
You can see the following details for each exception:
• Batch Number
• Group Numbers
• Comments
• Description
• Log Date & Time
32.0 08 February 2019 UI Improvement: 1) Moved the 'Merged Record Status Update Log' Button from the Main Session Detail page to the Statistics section of the Session Detail Page

2)When you suppress a record from the review screen it will now be added to a special session for storing Suppressed records.

The Suppressed record will be added to one of three Groups:
A) Suppressed Accounts
B) Suppressed Contacts
C) Suppressed Leads

These Groups can be found on the P&M Home Screen using the 'Select Session' drop-down with option 'Suppressed Groups'
31.0 04 January 2019 Session Result Searching Tweaked: In the session results screen you can now search for a record by the record name.
Audit Log Solution Improved: Added Ability to display which user made the change
Auto Fill Tweaked: Added the option to prevent data being overwritten with a NULL value in a group.
Error message Improved: Error messages and Informative messages improved throughout.
Solution file changes: Updated the Icon, Publisher Details and the User Permissions in the solution file.
30.0 11 December 2018 Added search functionality: Added search functionality to the Session Results screen.
You can now search the results for a specific record.
Security Role Integration: The Security Roles for Perfect & Merge will now be automatically created inside of CRM and can be assigned like normal CRM Privileges.
29.0 16 November 2018 Improved Session Statuses and Session Actions: New Session Statuses:
• 'Schedule in Progress' - Displays when the Scheduler is running.
• 'Schedule Completed' - Displays when the scheduler has finished.

New Session Actions:
• 'Started' - Displays when the match process has started.
• 'Closed' - Displays when the session is completed.
Improvements made to the scheduler: Added the ability to chain sessions together.

Added new Icons for the Scheduler status.
Added privilege error messages: Added various error message for when privilege requirements are not met.
28.0 24 October 2018 Auto Promote All immediately after Session Match: Added a new feature to run ‘Auto Promote All’ process immediately after the completion of match process for the session, so that you will get the Master Records in every group as per the ‘Master Records’ settings you have set.

2 new 'Session Statuses' have been added for the 'Auto Promote All'
• Auto Promote in Progress
• Auto Promote Completed
Audit Log Improvements: You can download ‘Managed’ or ‘Unmanaged’ solution as per your need to use the ‘Audit Log’ feature. You can download the solution files at any time from the ‘Help’ menu in P&M App.

‘Audit Log’ View (sub-grid) columns updates in CRM.
UI Improvements: 1. ‘Create Session’ Steps: Updated the 5 steps process image.

2. Moved the checkbox 'Match contacts at the same company only' to Step 1 instead of Step 4 in the Create Session process, and it will now only be visible only for the Contact Entity sessions

3. Replaced the text ‘Update’ with ‘Save’ on buttons throughout the application.
Bulk Merge Feature Removal: Removed the Bulk Merge feature throughout the application which was using parallel processing while merging records. Records shall be merged using sequential process only.
Scheduler access rights update for P&M Reviewer user: A user with 'Review' permission will no longer be able to schedule a session, and will only be able to view the schedule information a schedule.
P&M user acceptance before starting session level Auto Processes: The user now has to accept that the all duplicates in all groups for that session are in fact duplicates before starting any session level Auto Process.
27.0 10 September 2018 Auto Fill CRM Logging: You can now see the logs when CRM Records get updated by one of the following process in Single Entity Sessions:
- Auto Fill All (Session Level)
- Auto Promote & Fill All (Session Level)
- Auto Fill (Group Level)
- Manual Fill (Group Level)

You can view the following information in the logs on a Master Record CRM Page:
- Duplicate Account / Contact / Lead Name and its CRM record link (Winner Duplicates of which the attribute values are detected as best / Loser Duplicate of which the attribute values are lost)
- Attribute Name
- Best Value (of Winner Duplicate)
- Loser Value (of Looser Duplicate)
- Original Value (of Master Record)
- Best Value Used (Yes / No)

DQG Team can set one of the following option for you as per your choice:
- No Logs (Logs won’t be shown to you)
- Only Winning Records Logs (Logs for winner duplicate records attributes will be shown)
- All Records Logs (Logs for winner and loser duplicate records attributes will be shown)

Note: In this release the logging will not be available for customers who purchased the 'Cross-Entity' add-on, but this will be added in an upcoming release.
User Friendly Matching Statuses: Match Statuses updated with following:
A) Pre-Match:
1. Match Process Pending
2. Match Process Started
3. Feeding Primary Data - Batch XX – Batch Size: YY
4. Feed Completed for Batch XX (YY records)
5. Feeding Secondary Data - Batch XX – Batch Size: YY
6. Feed Process Completed
B) Post-Match:
7. Saving Match Results for Batch XX
8. Analysing Group Validity for Batch XX
9. Match Process Completed
Threshold Settings now using a Single Slider: Using single match slider, you can set the threshold settings.
By default, the slider is set to 95%. You can set the match percentage between 50 to 100% as per your requirement.
Improved Messages for some Processes: Pop-Up Message improved for the processes:
• Auto Exact and Merge All (Bulk)
• Auto Accept and Merge All (Bulk)
Review Screen User Interface Improvements: Review Screen User Interface Improvements:
•Center Aligned:
- 'Master Record' Header
- 'Duplicate Records' Header
- 'Attribute Groups' Sub-Header
- 'Values' Sub-Header

• Improvements to Record Grid structure
Terms And Conditions Link Added: Added link to our Terms and Conditions via the 'Help' menu
Record Status now view-able from 'Review Screen': You will now be able to view the Perfect and Merge Record Status in the Review Screen.
Once the record is update in the background the status will also change in the Review Screen, and you will no longer be required to navigate back to the 'Groups Listing' screen.
26.0 20 August 2018 User Interface Improvements: 1. Grid Structure Improvements throughout the application.
• Display of all the grid verticals and horizontal lines in suitable color and line weight.
• An alternate color scheme for the Grid Rows
2. Renaming of following labels throughout the application:
• Settings Menu:
- ‘Set Attribute Groups’ to ‘Attribute Groups’
- ‘Set Best Record’ to ‘Master Record’
- ‘Set Display & Auto Fill’ to ‘Display & Auto Fill’
- 'Set SmartMerge' to 'Smart Merge'
- 'Map Entities' to 'Cross Entity Mapping'

• Set Attribute Groups:
- ‘Field Groups Configuration’ to ‘Attribute Group Configuration’
- ‘Field Groups’ to ‘Attribute Groups’
- ‘Set Attribute Groups’ to ‘Attribute Groups’

• Set Attribute Group Rules:
- ‘Set Attribute Group Rules’ to ‘Attribute Group Transforms’
- ‘Group Rules’ to ‘Attribute Group Rules’
- ‘Rules’ to ‘Attribute Group Operators’
- ‘Match Rules’ to ‘Transforms’
- 'Input Phrase' to ‘Test Input Phrase’
- 'Result’ to ‘Test Result’
- Changed the description to “Select a rule from ‘Transforms’ and then drag to ‘Attribute Groups Rules’ section. You can set multiple rules against multiple attribute groups.”

• Set Best Record:
- ‘Set Best Record Settings’ to ‘Master Record Settings’
- ‘Rule Type’ to ‘Attribute Type’
- 'Rules Options’ to ‘Rule Options’

• Set Display & Auto Fill:
- ‘Set Display Settings’ to ‘Display Settings’
- ‘Display Section Configuration’ to ‘Display Attribute Configuration’
- ‘Sections’ to ‘Attribute Groups’
- 'Field Rules' to 'Attribute Rules'

• Renaming of 'Reset' to 'Clear'

• Review Screen:
- ‘Field’ to ‘Attribute Groups’
3. ‘No Matchkey’ listed at the bottom of the list of Match Key Algorithms.
4. Session Listing: Updated the columns alignment to center for following columns:
• Session Type
• Source Entity
• Target Entity
• Created By
• Match Started On
• Match Ended On
• Action
25.0 23 July 2018 Enable / disable the Null to Null attributes matching for Auto Exact & Merge Process: The user will now be able to enable or disable the attributes to be used for null to null match condition for the Auto Exact & Merge process.
User Interface improvements: 1. Set Best Records Settings:
• Rule Detail pop-up now will display the Rule Option details.

2. Set Display & Auto Fill Settings:
• Group Rule pop-up will display the ‘Section Name’.
• Field Rule pop-up will display the ‘Section Name: Attribute Name’.
• Changed “Show on PAM“ –> “Show on P&M”

3. Review screen:
• Map tooltip renamed to “Click to open in Google Maps”.
Inter-Match Feature: New records matching option is implemented which will perform the inter matching between the group of attributes and provides the matching scores accordingly.
Presently, the user will able to allow the session to perform either the Inter-Matching or Intra-Matching but not both.
Intra-Matching:
Intra-Matching: E.g. Compares the Email 1 with Email 1 only (previous default matching process)

Inter-Matching:
Inter-Matching: E.g. Compares the Email 1 with Email 1, Email 2 and Email 3 etc. and similarly the Email 2 and Email 3 also compared with Email 1, Email 2 and Email 3. Finally the average score will be considered of all the combinations.
Release All groups facility: You are now able to select and release all the groups at a time from the ‘Release Group’ section.
Improvements in Auto Fill Rules: If the Master Field Value for the Boolean Type is Null, you can mark while defining the Auto Fill-Field Rule to allow the population of unique value from duplicates to master if rule fails.
24.0 25 May 2018 Create sessions using shared personal or team views: Ability to create the sessions using the Shared Personal or Team Views is added into the P&M Application.

You can also able to clone the sessions created by other users using the views which are shared with you.
UI improvements for the Sessions with Match in progress: Instead of showing the whole row with ‘Grey’ background for the sessions for which the ‘Match Process’ is running, we are now highlighting only the ‘Match Status’ and ‘Status’ columns cells in ‘Green’ color for the sessions for which the ‘Match Process’ is running.
Improved review statuses for Suppressed Records: Renamed the ‘Suppress’ with ‘Permanently Suppressed and ‘Decline’ with the ‘Temporarily Suppressed’ buttons.

When the duplicates are permanently suppressed, review status for the duplicates will be updated to ‘Permanently Suppressed’. If the pair of Permanently Suppressed Master and Duplicates found later in other session, those will be treated as Permanently Suppressed only.

When the duplicates are temporarily suppressed, review status for the duplicates will be updated to ‘Temporarily Suppressed’. If the pair of Temporarily Suppressed Master and Duplicates found later in other session, those will be treated as Normal. The 'Temporarily Suppressed' records are suppressed only for the current session.
Inline editing for the ‘Date and Time’ fields in the Group Review screen: You will be able to edit the master record ‘Date and Time’ field values by double clicking on the field value. After ‘Accept and Merge’ the edited changes will be saved in the CRM.
23.0 21 May 2018 Entity Reference Attributes by ID/Name/Both: You can now identify easily the difference between the entity reference attributes in Review Screen.

Additional settings has been introduced in the ‘Display Settings’ to display the Entity Referenced Attributes in the Review Screen by any of the following way:
- ID
- Name (default)
- Both
Sequential Merging of records for ‘Auto Accept & Merge’ process: ‘Auto Accept & Merge All’ operation shall be performed Sequentially by using this new feature.

You will be provided with two options to process the ‘Auto Accept & Merge All’ operation:
- Bulk
- Sequential

You will be able to perform either Bulk or Sequential ‘Auto Accept & Merge All’ operation on a session.

For Bulk Processing: Records acceptance and merging will take place in parallel.

For Sequential Processing: Records acceptance and merging will take place in sequence. Recommended for quick merging of records.
Customized Solution to manage ‘Address Links’ Custom Entity to multiple instances: Modified this customized solution to be applied now for multiple customer instances.
Renamed ‘My Account’ to ‘Primary Account’: Renamed the ‘My Account’ section from the P& M application to ‘Primary Account’.

Renaming did at following two places:
- Settings Navigation Menu
- My Account Landing Page.
New Group added shall be included for Matching by default: When a new group is added in the ‘Set Attribute Groups’ Settings at following places, now it must be included for matching by default:
- Settings » Set Attribute Groups
- Create Session » STEP 2: Set Attribute Groups
- Session Detail » Set Attribute Groups
Improved Processes Descriptions: You can now see the improved user friendly messages on the user confirmation pop-ups for the following session and group level processes:
A) Session Level:
- Auto Exact and Merge All
- Auto Accept and Merge All
- Auto Promote All (first time)
- Auto Promote All (pre-process)
- Auto Fill All
- Auto Promote & Fill All
B) Group Level:
- Exact and Merge
- Accept and Merge
- Auto Promote (first time)
- Auto Promote (pre-process)
- Auto Fill
- Manual Promote
New icon for Location: New address location icon for the Records Addresses in the Review Screen is added.
UI improvements in Create Session Step 1: Switched the position of ‘NEXT’ and CANCEL’ buttons from the ‘Create Session’ Step 1 screen for uniformity. - Auto Fill All
Stop Match Process for deleted /deactivated sessions: When match process is currently running for a Session and before match process completion, if you deactivate / delete the session; the Match Process will stop for a session.

If the deactivated Session (before match completed) is activated again by you - you shall only able to Clone the session.
22.0 14 May 2018 Customized Solution to manage ‘Address Links’ Custom Entity: Provided a customized solution to one of Customer to manage the
‘Address Link’ Custom Entity linked addresses.
Customer Facing Issue: When the 'Account/Contact' entity records
get merged in CRM, the Addresses of the Merged Duplicates are linked
to Survive Master Records in the 'All Addresses' Custom Entity. But,
the flag for 'Is Primary' is copied as it is from the Merged Duplicates.
So, currently 'Is Primary' flag is set to 'TRUE' if the address is Primary
Address of the Duplicate Merged Record.
Solution Provided: When the Primary Addresses (having 'Is Primary'==TRUE) of Duplicate Merged Records are linked to survive 'Primary Record', set the 'Is Primary' flag to 'FALSE'.
Removed CRM Username and Password references: Removed the references of Username and Passwords from all the areas of the application.
Removed the references of database Username and Password from database connection string logged in the description of the message logs.
Advance level logging for ‘Auto Promote All’: Included the advance level debug log messages and converted the existing logs into basic level logs for ‘Auto Promote All’ process.
Improvements in Merge Process: Improved the execution of Merge Process by handling some known exceptions.
21.0 02 May 2018 Toggle the list of attributes between the Display Name and Schema Name: You can now toggle the list of attributes either by:
- Display Name or
- Schema Name
You can use this feature for attributes list from the following modules:
1. Settings
- Set Attribute Groups
- Set Best Record
- Set Display & Auto Fill
- Custom Settings » Memo Field Configuration
2. Create Session
- Set Attribute Groups
- Set Display & Auto Fill
3. Session Detail
- Set Attribute Groups
- Set Display & Auto Fill
Attributes List Search by Keywords: You can search the required Attribute from the list by using Keyword
Search feature. Please note - If the Attributes are listed by ‘Display
Name’, you can search only by the keywords for ‘Display Name’ and not by the keywords for ‘Schema Name’ and vice-versa.
You can use this feature for attributes list from the following modules:
1. Settings
- Set Attribute Groups
- Set Best Record
- Set Display & Auto Fill
- Custom Settings » Memo Field Configuration
2. Create Session
- Set Attribute Groups
- Set Display & Auto Fill
3. Session Detail
- Set Attribute Groups
- Set Display & Auto Fill
Display of Schema / Display Name on Attribute Name mouse hover: You can use this feature for attributes list from the following modules:
If Attributes are listed by ‘Display Name’, mouse hover on the Attribute Name you will able to see the ‘Schema Name’ for the respective Attribute and vice-versa.
1. Settings
- Set Attribute Groups
- Set Best Record
- Set Display & Auto Fill
- Custom Settings » Memo Field Configuration
2. Create Session
- Set Attribute Groups
- Set Display & Auto Fill
3. Session Detail
- Set Attribute Groups
- Set Display & Auto Fill
User ID with Email Address Appended: While adding New User to P&M Application along with User ID, you can see the Email Address of the respective user.
Reverted the logic for ‘Exclude from Matching’ to ‘Include for Matching:’ Reverted the logic for ‘Exclude from Matching’ to ‘Include for Matching’ in the ‘Set Attribute Groups’ Settings.
By default, all the groups are included for matching (all checkboxes checked). You can uncheck the group and mark them as excluded. The groups which are not included for matching still used for percentage scoring.
This change has been implemented at:
- Settings » Set Attribute Groups
- Create Session » Step 2: Set Attribute Groups
Re-run of Auto Promote All process: You can re-perform ‘Auto Promote All’ process as many times as you wants - only if no other Session Level Process is ran. If any other process executed after ‘Auto Promote All’, you won’t be able to re-perform ‘Auto Promote All’ process.
Sequential execution of Session Level Processes: Now following rules will be applied on the session level process execution:
1. All the Session Level Processes (including Auto Promote All) will be available to execute after ‘Auto Promote All’ process execution is done.
2. You will be able to execute only below session level processes after ‘Auto Fill All’ process execution is done.
- Auto Exact & Bulk Merge All
- Auto Exact & Sequential Merge All
- Auto Accept & Merge All
3. You will be able to execute only below session level processes after ‘Auto Promote & Fill All’ process execution is done.
- Auto Exact & Bulk Merge All
- Auto Exact & Sequential Merge All
- Auto Accept & Merge All
4. You will be able to execute only below session level processes after ‘Auto Exact & Bulk Merge All’ process execution is done.
- Auto Accept & Merge All
5. You will be able to execute only below session level processes after ‘Auto Exact & Sequential Merge All’ process execution is done.
- Auto Accept & Merge All
6. You won’t be able to perform any session level process after ‘Auto Accept & Merge’ process execution is done.
Hidden the Manual Fill arrows for Combined Fields: Hidden the option to manual filled the field values for the Combine Fields such as Address, Full Name, Created Date, Modified Date.
20.0 11 April 2018 Auto Exact and Sequential Merge: New process is introduced at session level namely ‘Auto Exact & Sequential Merge All’.

You will be able to perform either ‘Auto Exact & Bulk Merge All’ or ‘Auto Exact & Sequential Merge All’ process.

In ‘Auto Exact & Sequential Merge’ process Records Acceptance and Merging will takes place in sequence and hence it will help to merge the records quickly.
Edit and Update record value at review screen: Double clicking on the field, you will be able to view the field in editable mode now. You will be able to update the field value and save it. After successful save, the field value will be updated in the CRM as well for the record and the review screen updated. Currently this feature is available only for following Field Types:
1.Numeric
2.String
3.Boolean
Renamed Auto Exact and Merge All process: Renamed the ‘Auto Exact and Merge All’ process to ‘Auto Exact and Bulk Merge All’
19.0 22 March 2018 Location Functionality Update : This functionality is implemented on the Review page where records are displayed.

Display the Location marker against the address value fields. Up to 3 markers will be displayed against the address value.

Address will be displayed as tool tip on mouse hover in the respective order.

On click on the location marker respective address will be opened in Google maps.
URL field display as Hyperlink: This functionality is implemented on the Review page where records are displayed.

Hyperlink will be displayed against the website field, on click the website will be opened in browser.
Session Statistics Summary Panel: All the statuses of the records will be displayed after performing Session level and group level processes. Following will be displayed against each process:
• Action performed (Status)
• Start time
• End time
• Status
• Status with record count
Performance Improvement: Records are fetched in batches for match process and session level processes, resulting in faster processing.
Secure Access to Direct Link: When a direct link is opened it is redirected to the CRM login page. After the user is validated only then the P&M will be accessed.
Remove Opportunity from Source for Cross Entity: In Cross Entity remove Opportunity entity and only Lead entity should be present in the Source entity.
18.0 29 January 2018 Improved Session Creation Process: Improved Session creation process for Account and Contact Entity by providing the option to the P&M users whether to include the inactive records or not for the session.

By default, inactive records won’t be included at the time of session creation.

For Lead Entity Session, the P&M users won’t be able to include the disqualified leads at the time of new session creation.
17.0 06 December 2017 P&M Review Header Update: Updated the format for information to be shown in the P&M Header as follow:
Perfect & Merge Review: Reviewing Group Number (1.00) of (5)
Performance Improvements : Improved the performance of following screens to load the data faster:
1. Groups Listing
2. Review Screen
Improved Session Detail: Added the REFRESH button at the Session Detail grid clicking on which it will refresh the whole Session Detail grid information.
16.0 10 November 2017 Renamed ‘Select Group’ settings option : Renamed the ‘Select Groups’ settings option to ‘Set Attribute Groups’ throughout the application.
Renamed ‘Set Rule Builder’ settings option: Renamed the ‘Set Rule Builder’ settings option to ‘Set Attribute Group Rules’ throughout the application.
Lazy Loading: Implemented the lazy loading features on the following P&M pages:
1. Session Detail: The data will be loaded only after expanding the needed section.
2. Groups Listing: The records data will be loaded only after expanding the group.
Session Statistics Update: Updated the session statistics from the Session Detail page. Made following changes:
1. Removed ‘General’ section. The info from this section merged with the ‘Session Detail’ section.
2. Improved statistics in the ‘Session Detail’ section
3. Added the statistics for: Match Process and Overall Statistics.
4. The statistics for the other processes will be logged as they started for the Session by the user.
5. Added the process finish prediction (date & time) for Auto Promote & Fill All process ['Estimated Time To Finish']
6. The statistics will show the records status only for the respective process (except ‘Overall Statistics’)
7. Overall Statistics always shows the most recent status of the records from the session.
15.0 12 September 2017 Cross Entity Matching: Introduced a new feature which allows user to perform matching across the entities. To achieve this, following new modules added to the existing P&M application:
1. Match Entity Setup: To perform the default mapping for cross entity groups.
2. Cross Entity Mapping: To modify the default attribute mapping of the entities as per the need.
3. Select Group Settings: To define the ‘Select Group’ settings for cross entity sessions by selecting the Source and Target Entity and then add the Groups.
4. Set Display & Auto-fill Settings: To define the ‘Set Display & Autofill’ settings for cross entity sessions by selecting the Source and Target Entity and then add the Sections, Attributes, Group and Field Rules.
5. Auto Exact & Merge Rules Settings: To make the Auto Exact & Merge Rules active or inactive for the Cross Entity Sessions.
6. Create Session: To create a session to find out the duplicates between 2 different entities. The user can create a session for following combinations of entities:
• Lead-Account
• Lead-Contact
• Opportunity-Account
• Opportunity-Contact
7. Session Listing: Introduced following additional information for the sessions:
• Source Entity
• Target Entity
8. Session Details: Updated the session detail screen to display the modified settings for ‘Select Group’ and ‘Set Display & Auto-fill’ Settings.
9. Group Listing: Updated the Group Listing screen considering the cross entity sessions. Following changes made in the group listing:
• Default Record Name will be shown for the Source Entity Record in the Group Header
• Introduced following additional information for the sessions:
• Source Entity
• Target Entity
10. Group Review: Modified the Review screen for cross entity session so that the user can review the Source Entity Record and Target Entity Master and Duplicates side-by-side.
14.0 29 August 2017 More actions for Scheduler: You can schedule a session on following additional actions:
1. Match – Auto Fill
2. Match – Auto Fill – Auto Accept & Merge
3. Match – Auto Promote
4. Match – Auto Promote – Auto Fill
Effects on Scheduler(s): Effects on Scheduler(s) on following actions:
1. If the user deletes the session, the associated session scheduler(s) also deleted
2. If the user deactivates the session, the associated session scheduler(s) also deactivated
3. If the user re-activates the session, all the associate session scheduler(s) also re-activated. Displays a message window to user with the associated scheduler(s) which will be activated.
4. If the Customer gets deleted or deactivated, all the associated scheduler(s) also deleted / deactivated respectively.
Labeling Change: 1. Renamed the ‘Auto Merge’ label to ‘Auto Exact & Merge’ throughout the P&M Application.
2. Renamed the ‘Auto Merge All’ to ‘Auto Exact & Merge All’ throughout the P&M Application.
3. Renamed the ‘Auto Merge Rules’ to ‘Auto Exact & Merge Rules’ throughout the P&M Application.
4. Renamed the ‘Accept’ label to ‘Accept & Merge’ throughout the P&M Application.
5. Renamed the ‘Auto Accept’ label to ‘Auto Accept & Merge’ throughout the P&M Application.
6. Renamed the ‘Auto Accept All’ to ‘Auto Accept & Merge All’ throughout the P&M Application.
7. Renamed the ‘View Source’ label to ‘View Record’ throughout the system.
Removed ‘Accept (Accept & Merge)’ button dependency: Removed the ‘Accept (Accept & Merge)’ button dependency from ‘Auto Merge (Auto Exact & Merge)’
P&M Logo update: Updated the logo for Perfect and Merge Application
‘Owner’ as a new Rule / Attribute Type: Added ‘Owner’ as a new Rule / Attribute Type in the ‘Set Best Records’ and ‘Display & Auto Fill’ Settings
13.0 27 July 2017 Scheduler: Now you can automate the matching process by creating the schedulers for the sessions you want.
You can schedule the sessions for:
- One time
- Daily
- Weekly or
- Monthly
You can schedule the following actions on the scheduled cloned sessions:
- Match
- Match – Auto Exact & Merge
- Match – Auto Promote – Auto Accept & Merge
- Match – Auto Promote – Auto Fill – Auto Accept & Merge
You can make the scheduler as Active or Inactive any time
Improved Session Detail module: Detail statistics for Auto Promote and Auto Promote & Fill added.
You can view following details in the Session Detail:
A) Auto Promote:
1. Start Time
2. End Time
3. Status (Unprocessed / In Progress / Completed)
4. Record Statuses and the total record counts for the respective statuses
B) Auto Promote & Fill:
1. Start Time
2. End Time
3. Status (Unprocessed / In Progress / Completed)
4. Record Statuses and the total record counts for the respective statuses
12.0 27 June 2017 Improved Session Listing: A) Added following information in the session listing screen for each Session:
1. Match Started On
2. Match Ended On
B) Error Details:
If any error encountered during the match process for the session, you can view the details of the same by clicking on the error message link from the “Match Status”.
C) Records Fed
Now you can see the count of Records Fed during the match process run.
Improved Session Results/Groups Listing: If any error encountered during the Auto Merge All/ Auto Promote All/ Auto Fill All/ Auto Promote & Fill All for the group, you can view the details of the error by clicking on the error message link from the “Status” section.
Improved Session Detail module: Detail statistics for Auto Merge and Auto Fill added.
You can view following details in the Session Detail:

A) Auto Merge:
1. Start Time
2. End Time
3. Status (Unprocessed / In Progress / Completed)
4. Record Statuses and the total record counts for the respective statuses

B) Auto Fill:
1. Start Time
2. End Time
3. Status (Unprocessed / In Progress / Completed)
4. Record Statuses and the total record counts for the respective statuses
11.0 08 June 2017 Records count in group header: No need to expand each group to view the total duplicates present in a group. Now you can see the duplicate records count in the header of each Group.
Exclusion of deleted users from User Limit: The total user limit provided will exclude the deleted user. You can now delete as many users you want and add the users not exceeding the user limit.
Any time session clone: You can now clone the session at any time once it is created.
User confirmation for cloning the session: You need to confirm to proceed to create clone of the session for which Auto-merge process is going on in the background.
10.0 13 April 2017 User Interface Improvements: User interface improvements on below screens:
A) Review Screen / Group Detail:
1. Increased “Field” column width
2. Reduce the sizes of “View Source” & “Promote” buttons from
Duplicate Records
3. Removal of “Defer” button
C) Uniform Screen Heights for all the application pages.
New Generic Rule addition: Added new rule namely “Contains Data” under “Generic” Rule Type for “Set Best Records” Settings. “Contains Data” Rule will help the user to find out the Best Record using the attributes either containing or not containing the data.
Grouping of Session Duplicate Groups: Improved the Session groups listing by grouping all the duplicate groups and showing only the Primary Record. The user can view listing of all the duplicate groups by expanding the respective Primary Record.
User credentials update in PAM itself: The P&M application user don’t have need to share the credentials to Admin to update the existing credentials anymore. The user can now update the user ID along with the Password from the P&M application itself.
9.0 17 March 2017 User Interface Improvements: Added the icons for attributes shown on following screens; mouse hover on which it displays the respective attributes “type of attribute”.
- Settings » Select Group
- Settings » Set Best Record
- Settings » Set Display & AutoFill
- Settings » Custom Settings » Memo Field Configuration
- Session Detail »Select Groups
- Session Detail » Set Display & AutoFill
- Create Session » Step2-Select Groups
- Create Session » Step5-Set Display Settings
8.0 07 March 2017 Releasing groups at Session Level: Administrator user can release any reviewing group to any other user to review at Session Level. The Reviewer of the group can be changed any time by the Administrator user if the changes not accepted for the group.
Improved 'Set Display & Auto Fill' settings: Added filter for “Set Display & Auto Fill” settings to filter the Entity attributes by the ‘Type of Data’.
Best Record Rule DB Setup: Added DB setup for ‘Best Record Rule’ under Settings to retrieve the CRM Instance Fields.
Note: The user has to run the setup to retrieve fields. The setup must be run every time the fields get updated in the CRM.
7.0 16 February 2017 Faster Group Switching: Improvement in Next / Previous buttons functionality from the Group Review Screen. The user can switch in between the groups much faster now than earlier.
User Interface Improvements: 1. Removed the empty spaces utilizing the full height on the following screens:
• Settings » Set Rule Builder
• Settings » Select Groups
• Settings » Set Best Record
• Settings » Set Display Settings
• Settings » Custom Settings » Custom Transform Library Conf.
• Settings » Custom Settings » Category
• Create New Session » Step 3 Set Rule Builder
• Create New Session » Step 5 Set Display Setting

2. Removed “Assigned to yourself” column from the “Session Result” screen.
Auto Assignment of Groups: Auto assignment of Group to the user after click on Group Number from the Session Result screen
6.0 27 January 2017 'Set Best Record' settings at Field Level: Improved Set Best Records settings by providing the ability to apply the rules at the Entity field level.
Note: Rules applied for all the Entities if the field is common.
Review Screen Performance Improvements: Performance improvements on Review screen. Loading Primary & Secondary data in single request.
5.0 19 January 2017 User Interface Improvements: Following controls from the Review screen shifted to Groups screen for the better user interface:
• Auto Merge Rules
• Auto Promote All
• Auto Fill All
• Auto Promote & Fill All
• Auto Accept All
Improved Sessions List Sorting: Improved in the sort functionality of the columns having Date and Numeric data from the Sessions Listing
Transform Performance Improvements: Higher upgrade in the performance of Transformed functionality as compared to the previous version.
4.0 10 January 2017 MS Dynamics CRM 2016 Support: Perfect & Merge now works perfectly with the latest MS Dynamics CRM 2016 release.
Percentage Support for Duplicates: Added percentage for the followings on the Session listing screen that demonstrates the percentage of duplicates found against the record(s) fed that are based on the rule(s) set by the user during the session creation:
• Duplicates Found – (Percentage of number of duplicates records found out of the total records fed)
• Match – (Percentage of number of match records found out of the total duplicate records)
• Unsure – (Percentage of number of unsure records found out of the total duplicate records)
3.0 05 January 2017 Performance Improvements: Match speed is 4 times fast as compare to previous version.
Improved Group Navigation: This navigate feature help avoid the complexity of moving between
the groups while reviewing a group.
•On click of “Next” button, the user will be navigated to the next available group for reviewing.
•On click of “Prev” button, the user will be navigated to the previously available group for reviewing.
2.0 20 December 2016 Match contacts at the same company only Match contacts at the same company only – will displays the contacts have the same account name or id as duplicates in a particular company, If it’s unchecked then the match process for the same company will be ignored and the records will be matched across all companies.
Search functionality User can navigate between the records by using the following options:
•User can enter the Group No
•User can select a value from the review status dropdown box
•User can select a value from the reviewer dropdown box
1.0 01 April 2016 Auto Merge Merges records when the master and the secondary records are 100% identical.
Note: secondary to secondary identical records are not auto merged.
Auto Fill This feature helps the user to define the rules against any attribute or section/group/field group.
Auto Promote Auto Promote is available both at group/session level. Auto promote functionality help identify the best record in a group and promote it as a primary/master record.
revision_history.txt · Last modified: 2021/10/04 10:20 by conor.doyle