Data Engineer, Amazon Traffic Engineering

Description

We are seeking a talented Data Engineer to join Amazon's Traffic Engineering organization in developing next-generation bot detection and mitigation capabilities. As a Data Engineer, you'll be at the forefront of revolutionizing how we understand and leverage Traffic data used in Bot detection and mitigation. This is a critical challenge at the intersection of ML and cybersecurity. With GenAI/LLM-powered bots now capable of mimicking human behavior, evading traditional detections, and monetizing attacks, we must revolutionize our approach from reactive to real-time protection. Your expertise will solve crucial challenges in data processing and analytics. Imagine building the pipelines that transform raw traffic data into actionable insights. You'll tackle complex problems like real-time data processing, ensuring data accuracy across multiple platforms, and creating scalable solutions that can handle exponential growth in data volume.As the bridge between raw data and meaningful insights, you'll work with a diverse array of technologies, including Python, EMR, Spark,and Airflow, along with AWS services like Glue, Athena, and Redshift. But what truly sets this role apart is the opportunity to collaborate with cross-functional teams – from Scientists to Software Engineers to Program/Product – ensuring that your technical solutions align perfectly with business needs.Your contribution will extend beyond just building data pipelines. You'll be a key player in maintaining data governance and compliance, implementing sophisticated access controls, and ensuring data security through encryption and audit mechanisms. This role demands not just technical expertise, but also the ability to think strategically about data architecture and its impact on business outcomes.This role offers the unique opportunity to implement first-of-its-kind real-time behavior-based ML models that will safeguard Amazon's global infrastructure. Your work will directly impact millions of customers by ensuring the integrity and availability of Amazon's digital presence while advancing the state-of-the-art in automated threat detection and response.