Lead Data Engineer

Description

Join us as we embark on a journey of collaboration and innovation where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.

As a Lead Data Engineer at JPMorgan Chase within the Global Technology Enterprise Software Asset Management team you are an integral part of an agile team that works to enhance build and deliver data collection storage access and analytics solutions in a secure stable and scalable way. As a core technical contributor you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firms business objectives.

Job Responsibilities

• Lead data management strategies in collaboration with business stakeholders transforming data into insights that drive strategic decisions and organizational actions.
• Design develop and optimize ETL / ELT pipelines using SQL Python and PySpark for large-scale complex data environments.
• Implement scalable data processing workflows in data lake platforms such as Databricks or Spark ensuring efficient and reliable data operations.
• Ensure data quality consistency security and lineage throughout all stages of data processing and transformation.
• Support data migration and modernization initiatives transitioning legacy systems to cloud-based data warehouses.
• Document data flows logic and transformation rules to maintain transparency and facilitate knowledge sharing across teams.
• Troubleshoot and resolve performance and quality issues in both batch and real-time data pipelines.
• Review existing data challenges and deliver comprehensive solutions by applying appropriate data strategies and tools.

Required Qualifications capabilities and skills

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full-Time

Experience : years

Vacancy : 1