Big Data Lead

Description

Databricks Architect :

• 10- 12 years of experience in building solutionsusing Databricks on Azure or on Big Data, SQL Data, and other sources.
• In depth understanding of DataBricksArchitecture including Lakehouse, Performance tuning, Compute and Storage
• 1-2 Migration project level experience fromHadoop ecosystem to Azure Databricks & related DBs along with dataintegration job migration.
• Good knowledge and Proven practical experiencein migrating relational data base from on-prem to cloud OR to build cloud-baseddata lake using either Big Data / Azure Synapse / Databricks / Snowflake
• Experience in building data platforms usingAzure services like Azure Data Factory, ADLS Gen2, Databricks, Azure IaaS / PaaSdatabase and Azure Synapse data warehouse / analytical systems.
• Worked on the both the development andmaintenance projects and followed the operational processes.
• Hands-on experience on selecting and integratingany Data related tools and frameworks required to provide requestedcapabilities.
• Responsible for end-to-end data platform designand architecture for DataBricks on Azure.
• Extensive experience writing and tuning SQLqueries.
• In-depth knowledge in data virtualization usingDataIQ.
• 3+ years programming in one or more languages (PySpark,Python, Java, Scala)
• Excellent in Written and Verbal Communication
• Experience with Agile process methodology,CI / CD.
• Hands-on experience in ETL / ELT tools like FiveTran,Talend and Informatica Power Centre.
• Certification on cloud or DataBricks (related toData) would be preferred.
• Knowledge of Hadoop ecosystem will be an addedadvantage.