Skill : Big Data Senior Developer / Lead Technical :
- Hadoop, Hive, spark.
- Scripting knowledge (Python or Shell).
Functional :
Banking Financial Services and Insurance domainNon-Technical :
Experience in BFSI Information technology or equivalent.Possesses mastery level understanding of standards, business processes, workflows, methodologies, and leading practices.Must have in-depth knowledge of software development lifecycles including Agile development and testing.Demonstrated ability in applying automation for repeatable tasks.Strong management, communication, technical and remote collaboration skill are a must.Experience in large cross system, cross team initiatives.Experience Required :
Strong understanding and hands-on experience with big data technologies, including Hadoop ecosystem (HDFS, Hive, Spark, Sqoop).Experience in Data migration, incremental Data, Transformation, spark performance techniques.Experience in Monitoring and maintain data pipelines for optimal performance and scalability.Identify, analyze, and resolve data processing issues and cluster performance bottlenecks, ensuring high availability and reliability of data services.Create and maintain comprehensive documentation for data pipelines, ETL processes, data models, and cluster configurations to facilitate knowledge sharing and operational continuity.Responsibilities :
Analyzing, designing, developing, and driving solutions for major components and features.Ensuring secure, high code quality across the entire team.Interfacing with key stakeholders and business leaders.Resolving inconsistencies to gain consensus.Mentoring Junior Software Engineers.LI-CO1