[Remote] SENIOR DATA ENGINEER-REMOTE
Note: The job is a remote job and is open to candidates in USA. Foodbuy USA, operating under CDAI, is a data and artificial intelligence engine of Compass Group North America focused on delivering tailored solutions for the food service and hospitality sectors. They are seeking a hands-on Master Data Management (MDM) Data Engineer to design and implement scalable data architectures and solutions on AWS, collaborating with various teams to manage data pipelines and build APIs for analytics and reporting.
Responsibilities
- Design, develop, and deploy scalable and secure data pipelines and cloud-native architectures (data lakes, warehouses, and streaming pipelines) on AWS
- Build and maintain ETL/ELT workflows using AWS Glue, Lambda, and Python to support a variety of data integration needs
- Develop, deploy, and optimize APIs to enable seamless data access for business intelligence, analytics, and operational systems
- Analyze, debug, and resolve data quality issues and pipeline failures to ensure data accuracy and reliability
- Collaborate across teams—including data science, analytics, and software engineering—to design and implement reusable data models
- Ensure efficient, scalable, and secure serverless operations through performance tuning and best practices in AWS environments
- Create and maintain documentation, architecture diagrams, and data flow maps for internal and external use
- Implement and manage data governance, security protocols, compliance standards, and privacy best practices
- Incorporate AI tools, such as ChatGPT, to streamline engineering tasks, documentation, and data exploration
- Lead integration efforts with third-party APIs and data sources to expand the organization’s data capabilities
- Establish and enforce architectural best practices, CI/CD pipelines, and Infrastructure as Code (IaC) in collaboration with DevOps teams
- Mentor team members, stay current with AWS innovations, and champion modern data practices across the organization
Skills
- Bachelor's degree in computer science, Information Systems, Analytics, or related field
- 5+ years of experience in data architecture, engineering, or similar roles
- 3+ years of hands-on programming experience with Python
- 3+ years of experience building and managing ETL/ELT data pipelines
- Strong SQL skills and ability to write performant queries across various data stores
- Proficient with AWS services: Lambda, Glue, S3, DynamoDB, Athena, Redshift, and Snowflake
- Solid understanding of OLTP, ODS, and dimensional modeling techniques
- Experience designing APIs and integrating with API-driven data workflows
- Strong knowledge of serverless architecture patterns and best practices
- Excellent problem-solving, analytical, and communication skills
- Experience in agile development environments with CI/CD workflows
- Ability to collaborate across engineering, data, and business teams
- AWS Certifications (e.g., AWS Solutions Architect)
- Experience with modern data stack tools such as dbt, Snowflake, Databricks
- Familiarity with machine learning pipelines and AI-driven analytics
- Experience with Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation
- Background in DevOps and automated deployment strategies for data workflows
- Experience integrating with ServiceNow application
Benefits
- Medical
- Dental
- Vision
- Life Insurance/ AD
- Disability Insurance
- Retirement Plan
- Paid Time Off
- Holiday Time Off (varies by site/state)
- Associate Shopping Program
- Health and Wellness Programs
- Discount Marketplace
- Identity Theft Protection
- Pet Insurance
- Commuter Benefits
- Employee Assistance Program
- Flexible Spending Accounts (FSAs)
- Paid Parental Leave
- Personal Leave
- Associates may also be eligible for paid and/or unpaid time off benefits in accordance with applicable federal, state, and local laws. For positions in Washington State, Maryland, or to be performed Remotely, [click here](https://www.compass-usa.com/wp-content/uploads/2023/08/2023_WageTransparency_CorpAndFoodbuy.pdf) or copy/paste the link below for paid time off benefits information.
Company Overview