Building Blocks of Biml
This course teaches SQL Server Integration Services (SSIS) developers how to develop packages to perform extract-transform-load (ETL) operations for a data warehouse by using Business Intelligence Markup Language (Biml) as an alternative development approach.
What you'll learn
It’s generally accepted that creating and maintaining ETL packages with SQL Server Integration Services (SSIS) is one of the more time-consuming steps in the data warehouse development process, but what if there was a way to save time that can be used to solve bigger problems or expand the data warehouse scope? Rather than spend seemingly endless hours working through repetitive SSIS package development tasks and more hours tweaking those packages as schemas evolve, you can use Biml to create a framework that gracefully adapts to changes and updates package designs in minutes. This course introduces you to the Biml language by progressively building out files to support a data warehouse environment until you have a complete solution for staging data and loading the staged data into target dimension and fact tables.
Table of contents
- Introducing Biml 1m
- History of Biml 3m
- Problems Solved by Biml 3m
- Demo: Updating Packages for a Schema Change 3m
- Demo: Updating Packages for a Schema Change - Part 2 7m
- Tools for Biml 1m
- BIDS Helper 2m
- SQL Server Data Tools (or BIDS) 1m
- Demo: Configuring Visual Studio for Biml 4m
- Demo: Updating Packages with Biml 3m
- Notepad++ 1m
- Demo: Configuring Notepad++ for Biml 3m
- Optional: Mist Cloud 1m
- Demo: Using the Mist Cloud Application 3m
- Summary 2m
- Creating Your First Biml Files 1m
- Biml File Structure 2m
- Demo: Creating a Package 4m
- Online Documentation 1m
- Demo: Exploring Online Documentation 4m
- Sequence Containers and Constraint Modes 2m
- Demo: Using the Constraint Mode Attribute 4m
- Simple Elements and Attributes 0m
- Connections 1m
- Tasks 1m
- Task Attributes 1m
- Demo: Adding Connections and Tasks 5m
- Summary 1m
- Exploring Basic Biml Syntax in the Control Flow 1m
- Precedence Constraints 1m
- Demo: Working with Precedence Constraints - Part 1 6m
- Precedence Constraints with Options 1m
- Demo: Working with Precedence Constraints - Part 2 3m
- Special Characters in Expressions 1m
- Demo: Working with Special Characters 4m
- More ExecuteSQL Biml 1m
- Data Types - a Sampling 1m
- Variables 1m
- ExecuteSQL ResultSet 1m
- Demo: Configuring Execute SQL Tasks 6m
- Summary 1m
- Exploring Basic Biml Syntax in the Data Flow 1m
- Data Flow Source 2m
- Data Flow Destination 1m
- Demo: Adding a Data Flow Source and Destination 5m
- Transformations 1m
- Demo: Adding Data Flow Transformations 3m
- Pipeline Path Management 2m
- Demo: Working with Component Outputs 4m
- Error Handling 1m
- Flat File Connection, Format, and Destination 2m
- Demo: Error Handling 6m
- Summary 2m
- Introducing Biml Automation 1m
- BimlScript 2m
- BimlScript Components 1m
- Directives 1m
- Text Blocks 0m
- Control Blocks 2m
- Demo: Automating Biml with Control Blocks 6m
- MessageBox for Troubleshooting 0m
- Assembly Directive 1m
- MessageBox.Show() Method 0m
- Import Directive 0m
- Demo: Adding a Message Box 4m
- Summary 1m
- Automating Biml with Multiple Files 1m
- RootNode 1m
- Template Directive with Tier Attribute 1m
- Package Template 1m
- GetDatabaseSchema() Extension Method 2m
- Tables and Table Elements 2m
- Demo: Building a Package Template - Part 1 6m
- Demo: Building a Package Template - Part 2 7m
- GetBiml() Method 1m
- Demo: Retrieving Biml from Project Objects 3m
- Include Directive 1m
- Demo: Using the Include Directive 6m
- CallBimlScript() 1m
- Demo: Using the CallBimlScript() Method 6m
- Summary 1m
- Building Biml for Data Warehousing - Part 2 1m
- Load Packages - Dimensions 1m
- Where as Table Filter in Model 1m
- Annotation Tags for Tables to Load 1m
- Class Feature Control Block 1m
- Lookup 1m
- Conditional Split 1m
- Demo: Creating Dimension Load Packages - Part 1 5m
- Demo: Creating Dimension Load Packages - Part 2 4m
- Demo: Creating Dimension Load Packages - Part 3 8m
- Load Packages - Facts 1m
- Aggregate 1m
- OLE DB Command 1m
- Expression 1m
- Demo: Creating Fact Load Packages 8m
- Master Packages 3m
- Demo: Creating Master Packages 7m
- Summary 1m
About the author
Stacia Misner Varga is an instructor, author, and principal consultant of Data Inspirations. Her career spans more than 30 years, with a focus on improving business practices through technology. Since 2000, she has provided consulting and education services for Microsoft’s data platform and authored or co-authored many books covering this topic. In addition, Stacia has been a frequent speaker over the years at technology conferences worldwide.