Big Data Infrastructure Engineer(EKS/Databricks) Job at Insight Global, Glendale, CA

dk1JZTFyWlBqV3lvZlczQnlHb240Y0VBdHc9PQ==
  • Insight Global
  • Glendale, CA

Job Description

Job Description The Ad Infrastructure team is looking for a seasoned Data Software Engineer to help build and scale our data processing platforms. Project Outline: Moving Data from AWS/EKS(Kubernetes) into Databricks platform. What Youll Do: - Design, build, and maintain infrastructure automation and tooling that enables developers to deploy and operate cloud-native applications. - Implement best practices for secure, scalable, and cost-efficient cloud operations across AWS. - Contribute to and maintain a robust library of shared Terraform modules and infrastructure-as-code standards. - Participate in root cause analyses (RCAs) and postmortems to continuously improve reliability and operational practices. - Support container orchestration and workload scaling on Kubernetes (EKS) for Spark and Flink jobs. - Collaborate with development teams to ensure seamless onboarding and operational support for infrastructure tooling and platforms. - Participate in on-call rotations and own uptime and reliability of key systems. - Drive adoption of DevOps practices, including CI/CD workflows, observability, and incident management We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form ( . The EEOC "Know Your Rights" Poster is available here ( . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: . Skills and Requirements - 7 plus years of experience in infrastructure engineering, DevOps, or cloud-native software engineering. - 4 plus years of hands-on experience with Kubernetes, preferably on Amazon EKS. - 3 plus years of experience with Python or Go for infrastructure automation. - 3 plus years working with data processing frameworks such as Apache Airflow, Spark, or Flink. - 2 plus years designing and operating Databricks environments at scale on AWS, including performance tuning and securing workloads. - Expertise in AWS services (EC2, S3, IAM, VPC, etc.), infrastructure automation, and Terraform. - Experience with container technologies (Docker) and CI/CD tools like Spinnaker. - Strong communication skills and a collaborative mindset for working across engineering teams. - Hybrid to a local Disney hub: Glendale, SF, Seattle, - AWS Certifications (e.g., Solutions Architect, DevOps Engineer). - Familiarity with all three: Airflow, Spark, and Flink. - Experience operating service mesh technologies like Istio. - Experience running Spark or Flink workloads on Databricks. null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Job Tags

Local area,

Similar Jobs

Delta-T Group Inc.

Case Manager LMSW Job at Delta-T Group Inc.

 .... *Service a case load of approximately 22 clients. *Home visits and field work are required. *Able to maintain healthy boundaries......  ...separately incorporated. Delta-T Group is a referral service for self-employed independent contractors seeking behavioral healthcare... 

Scilight

Managing Editor Assistant Job at Scilight

 ...launch new journals based on research trends or needs of scholars/academic organizations;2.Participate or assist in journal management,...  ...are on-line in a timely and correct manner;5. assist the publisher/editor and journal editorial board team to achieve high quality... 

Angel Studios

Social Media Content Moderator Job at Angel Studios

 ...who want to build world-class products that will reshape media over the coming decades. Learn more about: Our North Star...  ...Job Description Summary/objective: Angel Studios Social Media Content Moderators role is to monitor online presence, and interact with social... 

LS Solutions

Salesforce Developer Job at LS Solutions

Title: Salesforce Developer Duration: 18 Months with possible extension Location: Remote POSITION DESCRIPTION: - Leverage Salesforce Public Sector foundation (Formerly Vlocity) configuration and/or customization to build and deliver Salesforce solutions that... 

GIA Legacy Planning

Independent LifeInsurance Agent - Remote Position Job at GIA Legacy Planning

 ...Independent Life Insurance Agent Remote Position Company: GIA Legacy Planning Location: Remote Position (Work from Home, Anywhere in the U.S.) Job Type: Full-Time | Part-Time | Uncapped Commission-Based About Us: We are committed to empowering our...