Job Description

Job Title: Lead Data Engineer
Location: Irving, TX - Hybrid

Must have:

Expert in Databricks, PySpark and Azure data services like ADF, Synapse etc.
Must have lead level experience
8+ years of professional data engineering experience, with proven technical leadership.
Deep understanding of Azure tech stack (Databricks, ADF, Key Vault, ASQL, ADLS Gen2, Service Principles etc.)
Deep experience with Databricks (design, optimization, notebooks, stored procedures, UDFs, etc).
Hands-on experience with ETL tools such as SSIS and Azure Data Factory.
Experience working with API calls and Ingesting data from external source systems
Experience with SQL, Python and PySpark
Experience with building dynamic and scalable solutions for data ingestion and curation
Experience in data engineering and MS SQL Server and T-SQL development.
Strong understanding of data lake/delta lake architectures and modern data pipelines.
Strong understanding of medallion architectures and design patterns.
Strong understanding of data modeling techniques.
Experience handling large-scale data volumes (millions of records).
Proficiency in building and maintaining CI/CD pipelines.
Experience with IaC technologies such as Terraform or Pulumi.
Exposure to big data tools (Spark, Hadoop, Kafka) preferred.
Experience with reporting tools such as Power BI or Tableau a plus.
Knowledge of .NET development beneficial for cross-team collaboration.
Prior experience working in an Agile development environment required.
Strong communication and collaboration skills with the ability to translate technical concepts to business partners.

What Success Looks Like:

You're the go-to technical lead for all things related to data design, integration, and performance.
You enable consistency and best practices across Azure, Databricks, SQL, ETL, and data engineering domains.
You mentor others while remaining hands-on with architecture and solution delivery.
You ensure the Internal Analytics platform continues to evolve as a reliable, scalable data source for the organization.

Job Tags

Similar Jobs

Top Level Promotions

Office Administration Assistant Work from Home Job at Top Level Promotions

...Perks: * Enjoy the convenience of working from your home office, eliminating the need for a daily commute. * No prior experience necessary all positions include comprehensive training. * Flexible options available for both in-person group meetings and...

Compass Group, North America

BARISTA (FULL TIME) Job at Compass Group, North America

...** Full time; Monday through Friday, hours may vary 5:00 am to 6:00 pm. More details upon interview.+ **Requirement:** No prior experience is required. **Willing to train!**+ **Fixed Pay Rate:** $15.00 per hour.**Make a difference in the lives of people, your community...

Indiana University

Assistant Director of Aquatics (Recreation Leader), Recreational Sports Job at Indiana University

RECREATIONAL SPORTS (BL-RECS-IUBLA) The Office of Student Life focuses on 3 key areas to support the student experience and their success... ...with teams across Outreach, Information Systems and Analytics, Operations, Financial Affairs, Member Services, Programming, Student...

Independence

Health Coach RN - remote (PA/NJ/DE) Job at Independence

Under the direction of the Care Management Manager, the Health Coach functions as the primary nurse to provide both health coaching and case... ...computer skills.Strong clinical knowledge.Fully Remote:This role is designated by Independence as fully remote. The...

Robert Half

Accounting Assistant (Part-Time) Job at Robert Half

...receivable transactions with accuracy and efficiency.- Accurately code and enter invoices into the system, ensuring compliance with... ....- Excellent attention to detail and accuracy in all tasks.- Entry-level candidates are welcome, provided they demonstrate a strong work...

Lead Data Engineer Job at AIT Global inc., Irving, TX

dGNNZTBiWk9oMld2ZDJ6UHhHa3M0Y2NBc3c9PQ==