Senior Data Engineer - AI Infrastructure

Location: United States, Washington, Redmond

Compensation:

USD $119,800 - $234,700 per year

Overview:

This role focuses on designing and implementing large-scale data pipelines, ensuring data correctness, and building scalable data models.

Responsibilities:

• Design and implement large-scale data pipelines using PySpark and distributed processing frameworks.
• Build and maintain data models that accurately represent underlying system behavior and business logic.
• Ensure high standards of data correctness, completeness, and consistency across datasets.
• Develop validation, monitoring, and alerting mechanisms to detect data quality issues.
• Partner with data scientists and collaborate with platform engineers for efficient data processing.
• Optimize pipelines for performance, scalability, and cost efficiency.

Qualifications:

Master's or Bachelor's Degree in relevant fields with 3+ or 4+ years of experience in data engineering or related areas.

Preferred Skills:

• Experience with Azure technologies (e.g., ADLS Gen2, Synapse Spark).
• Strong experience with PySpark and distributed data processing frameworks.
• Proficiency in Python and experience with cloud-based data platforms (Azure, AWS, or GCP).