Senior Data Engineer

Candidate should have a solid background in Data Engineering Databricks Python Snowflake PySpark SQL ETL and Data Warehousing.

Position Overview : As a Senior Data Engineer reporting to the Director of Information Technology you will be responsible for leading and owning the Enterprise Data Platform and its data todays data-driven world Enterprise Data Products are an absolute necessity streamlining the process of accessing crucial data ensuring data accuracy and reliability enabling efficient decision-making and empowering teams across the organization to collaborate effectively. You will work with cross-functional Portfolio and Business Teams ensuring data accessibility quality and efficient decision-making. You will be the subject matter expert and mentor for data-related activities driving the success of our data initiatives.

Key Responsibilities :

• Lead the development and implementation of data-related features and stories within the Enterprise Data Platform.
• Collaborate with data scientists business analysts and cross-functional teams to understand data requirements and priorities.
• Break down complex data tasks into manageable chunks and assign tasks to team members for delivery.
• Ensure high data quality standards and maintain the accuracy and reliability of data.
• Create and manage data models and validate them with key business representatives data owners data architects and end-users.
• Build automations to validate source-to-target data accuracy during build testing and support phases.
• Identify and resolve data-related issues proactively or based on input from end-users.
• Create complex and efficient SQL data transformations and views for various use cases.
• Perform SQL performance tuning including identifying and resolving performance bottlenecks join optimization data model optimization and data pre-processing.
• Oversee the creation of automated test cases to ensure data values are within expected ranges complete and within quality parameters.
• Develop job schedules for data flows and ensure seamless data integration.
• Mentor junior team members and offshore data engineers.
• Operate within a DevOps framework for maintaining source control and deploying database objects; create automated test cases when checking in DB objects.
• Ensure the health and quality of operational support provided by third-party services.

Position Qualifications :

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1