AWS Data Engineer

United Airlines

Remote

Sr. AWS Cloud Data Engineer / Architect (AWS Scala / Spark Developer)

Visa friendly

1 year ongoing contract

MUST HAVE

8+ years experience as a Data Engineer

Experience with Scala, Spark and Apache Flink streaming

AWS Cloud Development

Experience with Kafka and or other AWS streaming technologies (Apache Flink is idea and will be a start)

Python, Pyspark

SCALA IS NEEDED (PROFICIENT)

Pluses : Java experience

IBM MQ

Proficiency with ETL architecture.

Day to day :

Senior Scala and Spark Solutions Developer and Data Engineer capable of building a data standardized solution. Ideal candidate has extensive experience with both Data streaming and batch solutions including event-driven and microservices architecture. This is a high visibility, fast-paced key initiative that will integrate data across internal and external sources.

Responsibilities

• Designing, creating, and maintaining Scala-based data task to transform raw data into meaningful data models
• Participating in all architectural development tasks related to the data pipeline.
• Writing code in accordance with the data model requirements
• Collaborating with cross-functional teams
• Mentoring team members in Scala development and management
• Document Scala Development processes including Knowledge Documents, build and run books
• Work with business analysts to understand requirements
• Test to ensure designs are in compliance with specifications
• Debug and resolve technical issues
• Make recommendations to existing infrastructure
• Continually engage in professional development
• Develop documentation to track