Big Data Engineer

Job description Infosys is looking for Big Data Engineer who must be Polyglots with expertise in multiple technologies and can work as a full-stack developer in complex engineering projects. The ideal candidate has experience building products across the stack and a firm understanding of web frameworks, APIs, databases, and multiple back-end languages. The full stack developer will join a small team that uses new technology to solve challenges for both the front-end and back-end architecture, ultimately delivering amazing experiences for global users. Required Qualifications : Candidate must be located within traveling distance of Richardson, TX or Raleigh, NC or be willing to relocate to the area. Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.Deep expertise in Scala or Python for Spark application development along with SnowflakeExperience in end-to-end implementation of projects using Cloudera Hadoop, snowflake, Spark, Hive, HBase, Sqoop, Kafka, Elasticsearch, Grafana, ELK stackExperience in Categorizing, cataloging, cleansing and normalizing of datasets.Providing users access to datasets using REST and Python APIs.Extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS technologies.Experience in leading the migration of enterprise-scale data pipelines and analytics workloads from Google BigQuery to Snowflake. Deep expertise in Snowflake architecture, SQL optimization, and data modeling, as well as hands-on experience with Big Query schemas, UDFs, and partitioning strategies. Experience in translating query logic, optimizing performance, and ensuring data integrity throughout the migration. Familiarity with orchestration tools (e.g., Airflow, dbt), secure data sharing, and compliance with financial data governance standards is essential. Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this timePreferred Qualifications : Experience in data warehousing technologies, ETL / ELT implementationsSound Knowledge of Software engineering design patterns and practicesStrong understanding of Functional programming.Experience with Ranger, Atlas, Tez, Hive LLAP, Neo4J, NiFi, Airflow, or any DAG based toolsKnowledge and experience with Cloud and containerization technologies : Azure, Kubernetes, OpenShift and DockersExperience with data visualization tools like Tableau, Kibana, etcExperience with design and implementation of ETL / ELT framework for complex warehouses / marts Knowledge of large data sets and experience with performance tuning and troubleshootingBuilding end-to-end data integration and data warehousing solutions for analytics teams.Planning and Co-ordination skillsExperience and desire to work in a Global delivery environment.Ability to work in team in diverse / multiple stakeholder environment.The job may also entail sitting as well as working at a computer for extended periods of time. Candidates should be able to effectively communicate by telephone, email, and face to face. Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse / family member of a protected veteran; or disability.