Similar authors to follow
See more recommendations
About Andy Leonard
Customers Also Bought Items By
Frameworks not only reduce the time required to deliver enterprise functionality, but can also accelerate troubleshooting and problem resolution. You'll learn in this book how frameworks also improve code quality by using metadata to drive processes. Much of the work performed by data professionals can be classified as “drudge work”—tasks that are repetitive and template-based. The frameworks-based approach shown in this book helps you to avoid that drudgery by turning repetitive tasks into 'one and done' operations. Frameworks as described in this book also support enterprise DevOps with built-in logging functionality.
What You Will LearnCreate a stored procedure framework to automate SQL process executionBase your framework on a working system of stored procedures and execution loggingCreate an SSIS framework to reduce the complexity of executing multiple SSIS packagesDeploy stored procedure and SSIS frameworks to Azure Data Factory environments in the cloud
Who This Book Is For
Database administrators and developers who are involved in enterprise data projects built around stored procedures and SQL Server Integration Services (SSIS). Readers should have a background in programming along with a desire to optimize their data efforts by implementing repeatable processes that support enterprise DevOps.
The first part of the book starts with the basics—getting your development environment configured, Biml syntax, and scripting essentials.
Whether a beginner or a seasoned Biml expert, the next part of the book guides you through the process of using Biml to build a framework that captures both your design patterns and execution management. Design patterns are reusable code blocks that standardize the approach you use to perform certain types of data integration, logging, and other key data functions. Design patterns solve common problems encountered when developing data integration solutions. Because you do not have to build the code from scratch each time, design patterns improve your efficiency as a Biml developer.
In addition to leveraging design patterns in your framework, you will learn how to build a robust metadata store and how to package your framework into Biml bundles for deployment within your enterprise.
In the last part of the book, we teach you more advanced Biml features and capabilities, such as SSAS development, T-SQL recipes, documentation autogeneration, and Biml troubleshooting.
The Biml Book:
- Provides practical and applicable examples
- Teaches you how to use Biml to reduce development time while improving quality
- Takes you through solutions to common data integration and BI challenges
- Master the basics of Business Intelligence Markup Language (Biml)
- Study patterns for automating SSIS package generation
- Build a Biml Framework
- Import and transform database schemas
- Automate generation of scripts and projects
BI developers wishing to quickly locate previously tested solutions, Microsoft BI specialists, those seeking more information about solution automation and code generation, and practitioners of Data Integration Lifecycle Management (DILM) in the DevOps enterprise
Data Integration Life Cycle Management with SSIS shows you how to bring DevOps benefits to SSIS integration projects. Practices in this book enable faster time to market, higher quality of code, and repeatable automation. Code will be created that is easier to support and maintain. The book teaches you how to more effectively manage SSIS in the enterprise environment by drawing on the art and science of modern DevOps practices.
What You'll Learn
- Generate dozens of SSIS packages in minutes to speed your integration projects
- Reduce the execution of related groups of SSIS packages to a single command
- Successfully handle SSIS catalog deployments and their projects
- Monitor the execution and history of SSIS catalog projects
- Manage your enterprise data integration life cycle through automated tools and utilities
Database professionals working with SQL Server Integration Services in enterprise environments. The book is especially useful to those readers following, or wishing to follow, DevOps practices in their use of SSIS.
Why are custom components necessary? Because even though the SSIS catalog of built-in tasks and components is a marvel of engineering, there do remain gaps in the functionality that is provided. These gaps are especially relevant to enterprises practicing Data Integration Lifecycle Management (DILMS) and/or DevOps.
One of the gaps is a limitation of the SSIS Execute Package task. Developers using the stock version of that task are unable to select SSIS packages from other projects. Yet it’s useful to be able to select and execute tasks across projects, and the example used throughout this book will help you to create an Execute Catalog Package task that does in fact allow you to execute a task from another project. Building on the example’s pattern, you can create any task that you like, custom tailored to your specific, data integration and ETL needs.
What You Will Learn
- Configure and execute Visual Studio in the way that best supports SSIS task development
- Create a class library as the basis for an SSIS task, and reference the needed SSIS assemblies
- Properly sign assemblies that you create in order to invoke them from your task
- Implement source code control via Visual Studio Team Services, or your own favorite tool set
- Code not only your tasks themselves, but also the associated task editors
- Troubleshoot and then execute your custom tasks as part of your own project
Database administrators and developers who are involved in ETL projects built around SQL Server Integration Services (SSIS). Readers should have a background in programming along with a desire to optimize their ETL efforts by creating custom-tailored tasks for execution from SSIS packages.
SQL Server Integration Services Design Patterns is newly-revised for SQL Server 2014, and is a book of recipes for SQL Server Integration Services (SSIS). Design patterns in the book help to solve common problems encountered when developing data integration solutions. The patterns and solution examples in the book increase your efficiency as an SSIS developer, because you do not have to design and code from scratch with each new problem you face. The book's team of expert authors take you through numerous design patterns that you'll soon be using every day, providing the thought process and technical details needed to support their solutions.
SQL Server Integration Services Design Patterns goes beyond the surface of the immediate problems to be solved, delving into why particular problems should be solved in certain ways. You'll learn more about SSIS as a result, and you'll learn by practical example. Where appropriate, the book provides examples of alternative patterns and discusses when and where they should be used. Highlights of the book include sections on ETL Instrumentation, SSIS Frameworks, Business Intelligence Markup Language, and Dependency Services.
- Takes you through solutions to common data integration challenges
- Provides examples involving Business Intelligence Markup Language
- Teaches SSIS using practical examples