Senior Data Engineer

Vacancy details

Data Engineering

Data Engineer

Senior

United States

Hybrid

Apply now

Refer a friend now

Let’s breathe life into great tech ideas! With 3 000 people globally, Intellias is a company where benchmark technological solutions are born. Join in and take your part in digitalizing the world.

What project we have for you

We are looking for a highly skilled Senior Data Engineer to support and execute the transformation of our data platform from a legacy Microsoft SQL Server-based environment to a modern architecture built on Microsoft Fabric.

This role is hands-on and focuses on building scalable data pipelines, implementing Lakehouse architecture, and enabling efficient data processing using Spark and SQL technologies.

What you will do

Design, build, and maintain scalable data pipelines within Microsoft Fabric
Execute migration from Microsoft SQL Server (T-SQL, Stored Procedures, UDFs, Triggers, Constraints, C# integrations) to Fabric
Implement and support Lakehouse architecture (Bronze / Silver / Gold layers):
- Ingest raw data into Bronze layer using PySpark and Spark SQL
- Develop transformation logic using PySpark and notebook-based workflows
- Build refined datasets in Silver layer using T-SQL, UDFs, and Stored Procedures
- Deliver business-ready data models in Gold layer
Convert legacy SQL Server logic (Stored Procedures, UDFs) into scalable ELT pipelines
Develop and optimize Spark jobs (PySpark, Spark SQL) for large-scale data processing
Work with T-SQL notebooks and Warehouse layers for structured analytics
Ensure data quality, consistency, and reliability across pipelines
Optimize performance and cost of data workloads
Collaborate with Data Architects, Analysts, and BI teams to deliver high-quality datasets
Participate in code reviews and enforce best practices in data engineering
Monitor and troubleshoot data pipelines and production issues

What you need for this

5+ years of experience in Data Engineering
Strong experience with Microsoft SQL Server:
- T-SQL
- Stored Procedures, UDFs, data modeling
Hands-on experience with:
- PySpark
- Spark SQL
- Distributed data processing
Experience building ETL/ELT pipelines in modern data platforms
Familiarity with Microsoft Fabric or similar platforms (Databricks, Snowflake, Azure Synapse)
Experience working with large datasets (Big Data processing)
Solid understanding of data modeling concepts (dimensional modeling, star schema)
Experience with notebook-based development environments
Experience with Microsoft Fabric (Lakehouse, Warehouse, OneLake)

Will be a plus:

Experience migrating legacy systems to cloud data platforms
Familiarity with C#-based data integrations
Experience with real-time or streaming data pipelines
Knowledge of data governance and data quality frameworks
Experience with CI/CD for data pipelines

What it’s like to work at Intellias

At Intellias, where technology takes center stage, people always come before processes. By creating a comfortable atmosphere in our team, we empower individuals to unlock their true potential and achieve extraordinary results. That’s why we offer a range of benefits that support your well-being and charge your professional growth.
We are committed to fostering equity, diversity, and inclusion as an equal opportunity employer. All applicants will be considered for employment without discrimination based on race, color, religion, age, gender, nationality, disability, sexual orientation, gender identity or expression, veteran status, or any other characteristic protected by applicable law.
We welcome and celebrate the uniqueness of every individual. Join Intellias for a career where your perspectives and contributions are vital to our shared success.