Lead Azure Data EngineerDiligent Tec Inc • Atlanta, GA, Georgia, USA

Lead Azure Data Engineer

Diligent Tec Inc • Atlanta, GA, Georgia, USA

job_description.job_card.variable_days_ago

serp_jobs.job_preview.job_type

serp_jobs.job_card.full_time

job_description.job_card.job_description

Title : Lead Data Engineer

Location : Atlanta, GA (Onsite)

Duration : Long Term Contract

Description :

An Lead Azure Data Engineer is responsible for designing, implementing, and maintaining the data infrastructure within an organization. They collaborate with both business and IT teams to understand stakeholders’ needs and unlock the full potential of data. They create conceptual and logical data models, analyze structural requirements, and ensure efficient database solutions.

Must Have Skills :

SAP Data Experience
Proficiency in Databricks and Azure Cloud, Databricks Asset Bundles, Hoslistic vision on the Data Strategy.
Proficiency in Data Streaming and Data Modeling
Experience in architecting at least two large-scale big data projects
Strong understanding of data scaling and its complexities
Data Archiving and Purging mechanisms.

Job Responsibilities :

Act as subject matter expert providing best-practice guidance on data lake and ETL architecture frameworks suitable for handling big data for unstructured and structured information.

Drive business and Service Layer development with the customer by finding new opportunities based on expanding existing solutions and creating new ones.

Provide hands-on subject matter expertise to build and implement Azure-based Big Data solutions.

Research, evaluate, architect, and deploy new tools, frameworks, and patterns to build sustainable Big Data platforms for our clients.

Facilitate and / or conduct requirements workshops.

Responsible for collaborating on the prioritization of technical requirements.

Collaborates with peer teams and vendors on the solution and delivery.

Has overall accountability for project delivery.

Works collaboratively with the Product Management, Data Management, and other Architects to deliver for the cloud data platform and Data as a Service.

Consults with clients to assess current problem states, define desired future states, define solution architecture, and make solutions recommendations.

Design and implement scalable and reusable data models to support analytical and operational use cases, ensuring compatibility with various business applications.

Optimize data models for performance and scalability, addressing key challenges in data latency, volume, and complexity in a big data environment.

Ensure data quality and consistency by establishing robust data validation and governance mechanisms during the modeling process.

Collaborate with data scientists, engineers, and business stakeholders to translate business requirements into effective and efficient data models.

Job Requirements :

Degree in computer science or equivalent preferred

Demonstrable experience in architecture, design, implementation, and / or support of highly distributed applications with Azure cloud and Databricks.

8+ Years of Hands-on experience with data modelling, database design, data mining, and segmentation techniques.

Working knowledge and experience with "Cloud Architectures" (e.g., SaaS, PaaS, IaaS) and the ability to address the unique security considerations of secure Cloud computing

Should have architected solutions for Cloud environments such as Microsoft Azure and / or GCP

Experience with debugging and performance tuning in distributed environments

Strong analytical skills with the ability to collect, organize, analyse, and broadcast significant amounts of information with attention to detail and accuracy

Experience dealing with structured, unstructured data.

Must have Python, PySpark experience.

Experience in ML or / and graph analysis is a plus

serp_jobs.job_alerts.create_a_job

Azure Data Engineer • Atlanta, GA, Georgia, USA

Job_description.internal_linking.related_jobs

Lead Data Engineer (AWS, Azure, GCP)

Captech Consulting • Atlanta, Georgia, United States

serp_jobs.job_card.full_time

CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the resul...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted

Senior Data Engineer

steampunk • Atlanta, Georgia, USA

serp_jobs.job_card.full_time

We are looking for more than just a Senior Data Engineer we are looking for a technologist with excellent communication and customer service skills and a passion for data and problem solving.Lead a...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Senior Data Engineer – Azure & Databricks

Elvis Eckardt Recruitment & Sales Solutions Limited • Alpharetta, Georgia, USA

serp_jobs.job_card.full_time

Senior Data Engineer Azure & Databricks.Technology Consulting / Digital Transformation.Senior Data Engineer Azure & Databricks. This role is ideal for someone who thrives in complex enterp...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

SeniorLead Data Engineer

Cloudious LLC • Alpharetta, Georgia, USA

serp_jobs.job_card.full_time

Visa dependent candidate is fine.We are looking for an experienced.The ideal candidate will have deep hands-on experience with Databricks Spark modern data lakehouse architectures data modelling an...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Data Engineer - REMOTE

HHS Technology Group, Inc. • Atlanta, GA, US

serp_jobs.filters.remote

serp_jobs.job_card.full_time

At HHS Tech Group (HTG), our work matters, and each of us makes a difference in the lives of people every day.HTG is a leader in developing and delivering innovative, purpose-built modular software...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted

SeniorLead Data Engineer (Azure Databricks) Fulltime Role

Saransh Inc • Alpharetta, Georgia, USA

serp_jobs.job_card.full_time

Role : Senior / Lead Data Engineer (Azure Databricks).Location : Alpharetta GA (Onsite).The ideal candidate will have deep hands-on experience with Databricks Spark modern data lakehouse architecture...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Senior / Lead Data Engineer

Wissen Technology • Alpharetta, GA, United States

serp_jobs.job_card.full_time

The Wissen team continues to expand its footprint in the USA, Canada, UK, Australia, and India.More openings to come as we continue to grow the team!. Please read below for a brilliant career opport...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Data Engineer

Key2Source • Alpharetta, Georgia, USA

serp_jobs.job_card.full_time

Job Role : - Senior / Lead Data Engineer.Location : - Alpharetta GA (Hybrid 3 Days in Office).We are looking for an experienced Senior / Lead Data Engineer with 8 years of expertise in designing a...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Data Engineer

SmartIPlace • Atlanta, Georgia, USA

serp_jobs.job_card.full_time

Databricks data modeling w / Python.Years Focused on manipulating data in a software engineering capacity.Some of that data might live in relational systems but increasingly moving towards data Lake...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Data Engineer

Fanduel • Atlanta, Georgia, United States

serp_jobs.job_card.full_time

Our roster has an opening with your name on it.At FanDuel, our data platform underpins critical business operations that need to run with maximum efficiency and scalability.As our business continue...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted

Lead Azure Data Analyst

Bright Vision Technologies • Atlanta, Georgia, United States

serp_jobs.job_card.full_time +1

Bright Vision Technologies has an immediate contract opportunity for Lead Azure Data Analyst at Atlanta, GA.Lead Data Analyst will be responsible for analysing and modelling data to support our wea...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted

Data Architect / Palantir Foundry Solutions Architect

Vidorra LLC • Atlanta, GA, US

serp_jobs.job_card.full_time

Data Architect / Palantir Foundry Solutions Architect in San Francisco, CA (Hybrid).Architect scalable data platforms in. Design workflows and pipelines for real-time and batch data ingestion from S...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Senior Data Engineer - Connex Integration

Crunchtime • Atlanta, Georgia, United States

serp_jobs.job_card.full_time

Global restaurant brands run their operation on the Crunchtime platform.Delivering a consistent guest experience across every location and managing food and labor costs are at the core of how Crunc...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted

Lead Azure Databrick Engineer

Syren • Atlanta, Georgia, United States

serp_jobs.job_card.full_time

Individual Contractors (W2 / 1099) are encouraged to apply.Visa sponsorship is not available for this role at this time • • • • • • • • • • • •. An Azure Data Engineer is responsible for designing, implementing, ...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Lead Data Engineer

Honeywell • Atlanta, Georgia, USA

serp_jobs.job_card.full_time +1

The Data Engineer will be responsible for developing and implementing data-driven solutions and products that optimize operations enhance efficiency and drive growth for Honeywells Industrial custo...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Data Engineer Analytics Consultant

MCKEE NIX AND ASSOCIATES, INC • Tucker, Georgia, USA

serp_jobs.job_card.full_time

As a Data Engineer / Analytics Consultant at McKee-Nix & Associates you will be responsible for building and maintaining data infrastructure pipelines and analytics solutions that support busin...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted

Data Engineer

Extend Information Systems Inc. • Atlanta, GA, United States

serp_jobs.job_card.full_time

Design, develop, and maintain batch and streaming.AWS services (Glue, Lambda, Step Functions, etc.APIs, databases, streaming platforms). Amazon S3, Redshift, Athena, and Lake Formation.Collaborate w...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted

SeniorLead Data Engineer

Sumeru Solutions • Alpharetta, Georgia, USA

serp_jobs.job_card.full_time

We are looking for an experienced.The ideal candidate will have deep hands-on experience with Databricks Spark modern data lakehouse architectures data modelling and both batch and real-time data p...serp_jobs.internal_linking.show_more

serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted