DataBricks Architect Job at Abidi Group LLC, Houston, TX

c2NRWjA3SlBqMkd0ZW1qTHdXQW40OGNG
  • Abidi Group LLC
  • Houston, TX

Job Description

Technical Expertise:

  • Data bricks Mastery:  Deep, expert-level knowledge of the Data bricks Platform, including:
    • Unity Catalog:  Designing and implementing data governance and security.
    • Delta Lake & Delta Live Tables:  Architecture and building reliable, scalable data pipelines.
    • Performance & Cost Optimization:  Expertise in tuning Spark jobs, optimizing cluster usage, and managing platform costs.
    • MLOps:  Strong, practical understanding of the machine learning lifecycle on Data bricks using tools like MLflow.
    • Data bricks SQL:  Knowledge of designing and optimizing analytical workloads.
    • Mosaic AI:  Knowledge of designing and optimizing AI Agents.
  • Cloud & Infrastructure:  Deep knowledge of cloud architecture and services on AWS. Strong command of Infrastructure as Code (Terraform, YAML).
  • Data Engineering & Programming:  Strong background in data modeling, ETL/ELT development, and advanced, hands-on programming skills in Python and SQL.
  • CI/CD & Automation:  Experience with designing and implementing CI/CD pipelines (preferably with GitHub Actions) for data and ML workloads.
  • Severability:  Familiarity with implementing monitoring, logging, and alerting for data platforms.
  • Automation:  The platform is ephemeral, and all changes are implemented using Terraform and Python. Expertise in Terraform and Python is a must.

Job Tags

Contract work,

Similar Jobs

Firetrol Protection Systems

Fire Alarm Designer / AutoCAD drafter Job at Firetrol Protection Systems

 ...Founded in 1984, Firetrol is the national leader in fire protection & life safety services. We are currently seeking a Fire Alarm Designer / AutoCAD Drafter to join our team of over 1,200 of the best fire protection and security professionals in the industry. This... 

The Home Depot

DC Operations Manager Job at The Home Depot

 ...Loading), Transportation Operations (Yard, Carrier Relations) and/or Office Operations (e.g., Transportation Coordinators, Customer Service...  ...to maximizing productivity and leverage expenses for the Home Depot distribution center. DC Operations Managers must analyze trends,... 

Bobcat Transport

CDL Driver Team Drivers Needed - Dedicated Lanes - Earn $2,000+ Weekly Job at Bobcat Transport

Dedicated Freight Drop & Hook Home Every Other Weekend We're hiring CDL-A Teams (3+ months experience) for long dedicated runs with great equipment and steady pay. What We Offer: Dedicated Lanes & Customers consistent freight Schedule: Home every...

HomeWorks Energy, Inc.

Entry Level - Install Technician I Job at HomeWorks Energy, Inc.

 ...IMMEDIATE HIRE NEEDED! NO EXPERIENCE NEEDED!!! HomeWorks Energy is looking for hardworking Crew Members who want to start or continue their careers in the insulation trade and grow with the company. This is a full-time permanent role with plenty of room for growth... 

CMC Roofing

Safety Coordinator Job at CMC Roofing

 ...JOB TITLE: Safety Coordinator PAY GRADE: $75,000-$125,000 REPORTS TO: President/VP CLASSIFICATION: Exempt REVISION DATE: November 7, 2025 OPEN UNTIL FILLED POSITION SUMMARY TheSafety Coordinatorwill ensure a safe work environment by developing and...