SQL Server Data Quality Services

Publish in

Documents

6 views

Please download to get full document.

View again

of 23
All materials on our website are shared by users. If you have any questions about copyright issues, please report us to resolve them. We are always happy to assist you.
Share
Description
SQL Server Data Quality Services. Marc Jellinek Principal Consultant – Neudesic marc.jellinek@neudesic.com. About Me. Experience Principal Consultant - Neudesic Assistant Director (SQL Team) – Application Engineering at Ernst & Young IT Manager at MLB Network
Transcript
SQL Server Data Quality ServicesMarc JellinekPrincipal Consultant – Neudesicmarc.jellinek@neudesic.comAbout MeExperiencePrincipal Consultant - NeudesicAssistant Director (SQL Team) – Application Engineering at Ernst & YoungIT Manager at MLB NetworkSr. Technology Specialist at MicrosoftTechnologiesMicrosoft SQL Server 6.0, 6.5, 7.0, 2000, 2005, 2008, 2008 R2 and 2012Relational Engine, Analysis Services, Integration Services and Reporting ServicesMarc Jellinek – marc.jellinek@neudesic.comSession ObjectivesIntroduction to SQL Server Data Quality Services (DQS)Understanding the problemDemoWhere do we go from here?Setting the stageBuilding from the SQL Server Series: Master Data Services in SQL Server 2012, presented by Patrick Galluccihttp://www.neudesic.com/media/webcasts/20120501/20120501.wmv (start at 6:26)PASS MDM/DQS Virtual Chapter http://masterdata.sqlpass.orgBased on demos from “SQL Server 2012 Developers Update” The Data Quality Problem SpaceWhat’s The ProblemMy name is MarcJellinekMarc <> “Mark”, “Marck” or “March”Jellinek <> “Jelinek”, “Jellineck”, “Jelineck”, “Jelliner”, “Jeliner” or “Jellyneck”RrWhat’s the ProblemThe nightmare ScenarioThe Customer DimensionJelineck, MarckJelineck, MarchJelliner, MarcJelliner, MarkJelliner, MarckJelliner, MarchJelliner, MarcJelliner, MarkJelliner, MarckJelliner, MarchJellyneck, MarcJellyneck, MarkJellyneck, MarckJellyneck, March
  • Jellinek, Marc
  • Jellinek, Mark
  • Jellinek, Marck
  • Jellinek, March
  • Jelinek, Marc
  • Jelinek, Mark
  • Jelinek, Marck
  • Jelinek, March
  • Jellineck, Marc
  • Jellineck, Mark
  • Jellineck, Marck
  • Jellineck, March
  • Jelineck, Marc
  • Jelineck, Mark
  • Analytic ImpactAverage Revenue per customerAverage Profit per customerNumber of customersCustomers per GeographyCustomers by IncomeCustomers by GenderCustomers by Educational LevelCustomers by Product BoughtObligatory TruismsThe accuracy of your reporting is determined by the accuracy of your data (Garbage In, Garbage Out)Decisions made based on data will only be as good as the data on which you are basing your decisions.You can’t manage what you can’t measure. Inaccurate measurements lead to interesting management challenges.The Data Quality Solution SpaceAmend, remove or enrich data that is incorrect or incomplete. This includes correction, enrichment and standardization.Identifying, linking or merging related entries within or across sets of data.CleansingMatchingProfilingMonitoringAnalysis of the data source to provide insight into the quality of the data and help to identify data quality issues.Tracking and monitoring the state of Quality activities and Quality of Data.SQL Server 2012 Data Quality ServicesData Quality Services (DQS) is a Knowledge-Driven data quality solution enabling IT Pros and data stewards to easily improve the quality of their dataHigh quality data is critical to effective business intelligence and to business activitiesDQS is an on-premise Data Quality product in SQL Server 2012, extendible with knowledge from multiple parties thru Azure DataMarket Richer DQ knowledge and capabilities in the cloud will make it even easier to provide high quality dataIncluded with SQL Server 2012 Enterprise and BI EditionsKey Data Quality Services Concepts
  • Knowledge-Driven
  • Based on a Data Quality Knowledge Base (DQKB)
  • Semantics
  • Data Domains capture the semantics of your data
  • Knowledge Discovery
  • Acquires additional knowledge the more you use it
  • Add user-generated knowledge&3rdparty reference data providers
  • Open and Extendible
  • Easy to use
  • User experience designed for increased productivity
  • DQS ArchitectureAzure Market PlaceDQ ClientsDQS UIMS DQ Domains StoreCategorized Reference DataCategorized Reference Data ServicesKnowledge Discovery and ManagementDQ Active Projects3rd Party / InternalDQ ServerReference Data API(Browse, Get, Update…)RD Services API(Browse, Set, Validate…)Interactive DQ ProjectsDQ EngineReference Data ServicesData ExplorationCleansingData Profiling & ExplorationKnowledge DiscoveryReference DataMatchingReference Data SetsKnowledge Base StoreDQ Projects StoreCommon Knowledge StoreSSIS DQ ComponentMS Data DomainsLocal Data DomainsPublished KBsMDS Excel Add inData Quality Services ProcessesCloud ServicesKnowledgeManagementReferenceDataBuildDiscover / Explore DataEnterpriseDataManage KnowledgeIntegratedProfilingProgressStatusNotificationsKnowledgeBaseCorrect & standardizeMatch & De-dupeUseDQ ProjectsBasic DefinitionsKnowledge BaseStores all the knowledge related to a specific type of data sourceContainer for domainsDomainSemantic representation of a type of data in a data field or columnTrusted values, invalid values and erroneous dataSynonym associations, term relationships, validation and business rules, matching policiesMatching RuleSet of rules and conditions that determine a match or duplicateData Quality Services ComponentsData Quality ServerData Quality ClientDQS Cleansing Component for SQL Server IntegrationData Quality Processes in Master Data Management Data Quality Services ComponentsData Quality ServerSQL Server DatabasesDQS_MAINDQS Stored Procedures, the DQS Engine and published Knowledge BasesDQS_PROJECTSData required for knowledge base management and DQS project activitiesDQS_STAGING_AREAIntermediate staging area where source data is copied and processedData Quality Services ComponentsData Quality ClientStandalone applicationDesigned for both data stewards and DQS AdministratorsPerform knowledge management, data quality projects and administration in one user interfaceAllows for domain management, matching policy creation, data cleansing, matching, profiling, monitoring and server administration.Can be installed on a remote computerData Quality Services ComponentsDQS Cleansing Component in SQL Server Integration ServicesPerforms data cleansing as a part of an SSIS packageAlternative to running a cleansing project within the Data Quality Services Client applicationData Quality Processes within Master Data ServicesPerform de-duplication on source data and master data within the Microsoft SQL Server Data Services Add-in for Microsoft Excel.DEMOResourcesDBI207: Using Knowledge to Cleanse Data with Data Quality Serviceshttp://channel9.msdn.com/Events/TechEd/NorthAmerica/2011/DBI207Data Quality Services Bloghttp://blogs.msdn.com/b/dqsBooks Online for SQL Server - Data Quality Serviceshttp://technet.microsoft.com/en-us/library/ff877925(SQL.110).aspxInstall Data Quality Serviceshttp://technet.microsoft.com/en-us/library/gg492277.aspxUsed Master Data Services Configuration Manager, set up IIShttp://msdn.microsoft.com/library/ee633744%28SQL.110%29.aspxTroubleshoot Installation and Configuration Issues (Master Data Services in SQL Server 2012http://go.microsoft.com/fwlink/?LinkId=226284SQL Server 2012 Developer Training Kit Web Installer http://www.microsoft.com/en-us/download/details.aspx?id=27721SQL Server 2012 Update for Developers Training Workshophttp://social.technet.microsoft.com/wiki/contents/articles/6981.sql-server-2012-update-for-developers-training-workshop.aspxSQL Server 2012 Update for Developers Training Kithttp://social.technet.microsoft.com/wiki/contents/articles/6982.sql-server-2012-developer-training-kit-bom-en-us.aspxSQL Server 2012 Update for Developers Training Kit Contenthttp://social.technet.microsoft.com/wiki/contents/articles/6976.sql-server-2012-developer-training-kit-content-en-us.aspxMSDN – Data Quality Serviceshttp://msdn.microsoft.com/en-us/library/ff877925(v=sql.110).aspxMSDN Discussions – Data Quality Serviceshttp://social.msdn.microsoft.com/Forums/en-US/sqldataqualityservices/threadsTechnet – Data Quality Serviceshttp://technet.microsoft.com/en-us/library/ff877925.aspxPASS MDM/DQS Virtual Chapterhttp://masterdata.sqlpass.orgTHANK YOU
    Related Search
    We Need Your Support
    Thank you for visiting our website and your interest in our free products and services. We are nonprofit website to share and download documents. To the running of this website, we need your help to support us.

    Thanks to everyone for your continued support.

    No, Thanks