Senior Data Engineer โ MSSQL to Snowflake Migration (Fivetran + dbt)
Responsibilities
Migration & Translation
- Analyze existing SQL Server stored procedures that feed SSRS reports โ catalog business logic, conditional transformations, and reporting-specific edge cases
- Translate stored procedure logic into dbt models (staging, intermediate, and mart layers) using idiomatic SQL and dbt best practices
- Design the Snowflake schema architecture (raw, staging, marts) aligned with dimensional modeling principles
Ingestion & Pipeline Design
- Configure and manage Fivetran connectors for MSSQL source replication into Snowflake raw layer
- Define sync cadence, schema drift handling, and incremental vs. full-load strategies per source table
- Coordinate with internal engineers managing the existing Go-based ETL to plan cutover and parallel-run periods
dbt Development & DataOps
- Build a production-grade dbt project: models, tests, documentation, sources, exposures, and freshness checks
- Implement data quality testing (schema tests, custom singular tests, row-count reconciliation against legacy outputs)
- Establish CI/CD for dbt (slim CI on PR, scheduled full builds) integrated with Git workflows
Validation & QA
- Design and execute output parity validation between legacy SSRS reports and new Snowflake-based models
- Build reconciliation dashboards or automated comparison queries to catch drift during parallel-run
- Document edge cases, assumptions, and any logic gaps surfaced during migration
Governance & Observability
- Implement RBAC and row-level security in Snowflake aligned with existing access patterns
- Establish data lineage visibility via dbt docs and/or integration with observability tooling
- Define and enforce naming conventions, model layering standards, and code review practices
Required Qualifications
- 5+ years working with SQL Server (T-SQL), including complex stored procedures and SSRS
- 3+ years with Snowflake (schema design, performance tuning, warehouse sizing, access control)
- 2+ years building production dbt projects (models, tests, macros, packages, CI/CD)
- Hands-on experience with Fivetran (connector configuration, sync management, schema handling)
- Deep understanding of dimensional modeling and data mart architecture
- Strong knowledge of where SQL Server and Snowflake SQL diverge (window functions, date handling, CTEs, semi-structured data, MERGE behavior)
- Excellent documentation skills โ commented models and clear decision records are part of the deliverable
Preferred Qualifications
- Experience migrating SSRS reporting logic to a modern BI layer (Looker, Power BI on Snowflake, or Sigma)
- Familiarity with Go, particularly for understanding existing ETL transformation logic
- Experience with data observability tools (Monte Carlo, Elementary, or dbt tests at scale)
- Background in fitness/wellness, SaaS, or multi-tenant/franchise data environments
- Experience running parallel-run validation (old system vs. new system side-by-side)