Data Engineer, Amazon Traffic Engineering Mid

Data Engineer, Amazon Traffic Engineering

We are seeking a talented Data Engineer to join Amazon's Traffic Engineering organization in developing next-generation bot detection and mitigation capabilities. As a Data Engineer, you'll be at the forefront of revolutionizing how we understand and leverage Traffic data used in Bot detection and mitigation. This is a critical challenge at the intersection of ML and cybersecurity.

Skills, with evidence

• Airflow / orchestration As the bridge between raw data and meaningful insights, you'll work with a diverse array of technologies, including Python, EMR, Spark, and Airflow. must have
• Python Your expertise will solve crucial challenges in data processing and analytics. must have
• SQL 1+ years of developing and operating large-scale data structures for business intelligence analytics using SQL experience. must have
• Spark You'll tackle complex problems like real-time data processing, ensuring data accuracy across multiple platforms, and creating scalable solutions that can handle exponential growth in data volume. must have
• AWS Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions. must have · not practised here
• Streaming With GenAI/LLM-powered bots now capable of mimicking human behavior, evading traditional detections, and monetizing attacks, we must revolutionize our approach from reactive to real-time protection.

  - 1+ years of developing and operating large-scale data structures for business intelligence analytics using data modeling experience

• Governance & security You'll be a key player in maintaining data governance and compliance, implementing sophisticated access controls, and ensuring data security through encryption and audit mechanisms. not practised here
• Machine learning This role offers the unique opportunity to implement first-of-its-kind real-time behavior-based ML models that will safeguard Amazon's global infrastructure. not practised here