job_description.job_card.job_descriptionDesign and Develop methods to connect & collect data from different data sources -Analyze and understand data sources & APIs -Design and Develop methods to filter / cleanse the data -Design and Develop SQL, Hive queries, APIs to extract data from the store -Work closely with Data Scientists to ensure the source data is aggregated and cleansed -Work with Product Managers to understand the business objectives -Work with cloud and data architects to define robust architecture in cloud setup pipelines and workflows -Work with DevOps to build automated data pipelines - 5+ years of programming experience on data platforms - Data Engineering. Hands-on design and development of big data platform - Data processing technology stacks : Spark, HBase, Hive and other Hadoop ecosystem technologies and development using Scala or Java - Streaming data architectures and technologies for real-time and low-latency data processing - Agile development methods including core values, guiding principles, and key agile practices - Application of Continuous Integration / Delivery - Relational databases; SQL and PLSQL - NoSQL technologies including column family, graph, document, and key-value data storage technologies - Financial Industry -Bachelor's degree in a technical discipline (preferably computer science) or equivalent experience INDFSINS L1-NAM