Talent.com
SeniorLead Data Engineer (Azure Databricks) Fulltime Role
SeniorLead Data Engineer (Azure Databricks) Fulltime RoleSaransh Inc • Alpharetta, Georgia, USA
SeniorLead Data Engineer (Azure Databricks) Fulltime Role

SeniorLead Data Engineer (Azure Databricks) Fulltime Role

Saransh Inc • Alpharetta, Georgia, USA
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Role : Senior / Lead Data Engineer (Azure Databricks)

Location : Alpharetta GA (Onsite)

Job Type : Full Time

Description :

  • Looking for an experienced Senior / Lead Data Engineer with 8 years of expertise in designing and delivering scalable high-performing data solutions on the Azure ecosystem.
  • The ideal candidate will have deep hands-on experience with Databricks Spark modern data lakehouse architectures data modelling and both batch and real-time data processing.
  • You will be responsible for driving end-to-end data engineering initiatives influencing architectural decisions and ensuring robust high-quality data pipelines.

Experience and Qualifications (Required) :

  • 8 years of hands-on data engineering experience in enterprise environments.
  • Strong expertise in Azure services especially Azure Databricks Functions and Azure Data Factory (preferred).
  • Advanced proficiency in Apache Spark with Python (PySpark).
  • Strong command over SQL query optimization and performance tuning.
  • Deep understanding of ETL / ELT methodologies data pipelines and scheduling / orchestration.
  • Hands-on experience with Delta Lake (ACID transactions optimization schema evolution).
  • Strong experience in data modelling (normalized dimensional lakehouse modelling).
  • Experience in both batch processing and real-time / streaming data (Kafka Event Hub or similar).
  • Solid understanding of data architecture principles distributed systems and cloud-native design patterns.
  • Preferred :

  • Experience with CI / CD tools such as Azure DevOps and Git.
  • Familiarity with IaC tools (Terraform ARM).
  • Exposure to data governance and cataloging tools (Azure Purview).
  • Experience supporting machine learning or BI workloads on Databricks.
  • Note : Visa Independent candidates are highly preferred

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full Time

    Experience : years

    Vacancy : 1

    serp_jobs.job_alerts.create_a_job

    Azure Data Engineer • Alpharetta, Georgia, USA

    Job_description.internal_linking.related_jobs
    Data & BI Senior Data Engineer

    Data & BI Senior Data Engineer

    Axiom Software Solutions Limited • Atlanta, GA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    Sumeru Solutions • Alpharetta, GA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    We are looking for an experienced Senior / Lead Data Engineer with 8+ years of expertise in designing and delivering scalable, high-performing data solutions on the Azure ecosyste...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Lead Azure Databrick Engineer (Atlanta)

    Lead Azure Databrick Engineer (Atlanta)

    Syren • Atlanta, GA, US
    serp_jobs.job_card.part_time
    Individual Contractors (W2 / 1099) are encouraged to apply.Visa sponsorship is not available for this role at this time • • • • • • • • • • • •. An Azure Data Engineer is responsible for designing, implementing, ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    Wissen Technology • Alpharetta, GA, United States
    serp_jobs.job_card.full_time
    The Wissen team continues to expand its footprint in the USA, Canada, UK, Australia, and India.More openings to come as we continue to grow the team!. Please read below for a brilliant career opport...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • Atlanta, GA, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Lead Data Engineer - Palantir Foundry

    Lead Data Engineer - Palantir Foundry

    Smurfit Westrock • Atlanta, GA, United States
    serp_jobs.job_card.full_time
    Our technology organization is transforming how we work at WestRock.We align with our businesses to deliver innovative solutions that : . Address specific business challenges, integrate processes, and...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Staff Data Engineer

    Senior Staff Data Engineer

    Warner Bros. Discovery • Atlanta, Georgia, United States
    serp_jobs.job_card.full_time
    Discovery, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Discovery… the stuff dreams are...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer w / Python & SQL

    Data Engineer w / Python & SQL

    A2C • Alpharetta, GA, United States
    serp_jobs.job_card.full_time
    We’re looking for a Data Engineer to build and maintain scalable data pipelines and cloud data infrastructure on.ETL / ELT to support analytics and ML workflows. A problem solver with ability to analy...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    SR Data Engineer

    SR Data Engineer

    Alliance Technical Group • Atlanta, GA, United States
    serp_jobs.job_card.full_time
    Alliance Technical Group is seeking an experienced Senior Data Engineer to design, build, and optimize the databases and data systems that power our business intelligence and analytics platforms.In...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Data Engineer - Capital One Software (Remote)

    Lead Data Engineer - Capital One Software (Remote)

    Capital One • Atlanta, GA, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    Lead Data Engineer - Capital One Software (Remote).Capital One Software is seeking a Lead Data Engineer who is passionate about marrying innovation with emerging technologies.In 2022, we publicly a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    Diligent Tec Inc • Atlanta, GA, Georgia, USA
    serp_jobs.job_card.full_time
    Title : Lead Data Engineer Location : Atlanta, GA (Onsite) Duration : Long Term Contract serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Senior Data Engineer

    Senior Data Engineer

    Techgene Solutions • Alpharetta, GA, United States
    serp_jobs.job_card.full_time
    Position : Senior Data Engineer (PySpark + Databricks + Oracle / PostgreSQL Migration).Location : 5800 Windward Parkway, Alpharetta, GA 3000. Expert-level proficiency in PySpark and Databricks.Primary S...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior / Lead Data Engineer (Alpharetta)

    Senior / Lead Data Engineer (Alpharetta)

    Wissen Technology • Alpharetta, GA, United States
    serp_jobs.job_card.full_time
    The Wissen team continues to expand its footprint in the USA, Canada, UK, Australia, and India.More openings to come as we continue to grow the team!. Please read below for a brilliant career opport...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Extend Information Systems Inc. • Atlanta, GA, United States
    serp_jobs.job_card.full_time
    Design, develop, and maintain batch and streaming.AWS services (Glue, Lambda, Step Functions, etc.APIs, databases, streaming platforms). Amazon S3, Redshift, Athena, and Lake Formation.Collaborate w...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Senior Release Engineer

    Senior Release Engineer

    Cloudera • Atlanta, GA, United States
    serp_jobs.job_card.full_time
    At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Deploy • Atlanta, Georgia, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    DEPLOY's client is building a next-generation business management platform from the ground up and were looking for a hands-on Senior Data Engineer to deliver and scale our data strategy.As we grow ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Data Engineer (Levels III \u2013 V)

    Data Engineer (Levels III \u2013 V)

    Oglethorpe Power • Tucker, Georgia, United States
    serp_jobs.job_card.full_time
    IT, focuses on building and operating the data platforms, pipelines, and services that power analytics and decision\u2011making across the enterprise. You will design and maintain robust, scalable d...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Inherent Technologies • Atlanta, GA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Position : Senior Data Engineer Location : Atlanta, GA [ONSITE] serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days