Data Engineer

Job Role : - Senior / Lead Data Engineer

Location : - Alpharetta GA (Hybrid 3 Days in Office)

Duration : - Fulltime

Job Description : -

We are looking for an experienced Senior / Lead Data Engineer with 8 years of expertise in designing and delivering scalable high-performing data solutions on the Azure ecosystem. The ideal candidate will have deep hands-on experience with Databricks Spark modern data lake house architectures data modelling and both batch and real-time data processing. You will be responsible for driving end-to-end data engineering initiatives influencing architectural decisions and ensuring robust high-quality data pipelines.

Responsibility : -

• Architect design and implement scalable data platforms and pipelines on Azure and Databricks.
• Build and optimize data ingestion transformation and processing workflows across batch and real-time data streams.
• Work extensively with ADLS Delta Lake and Spark (Python) for large-scale data engineering.
• Lead the development of complex ETL / ELT pipelines ensuring high quality reliability and performance.
• Design and implement data models including conceptual logical and physical models for analytics and operational workloads.
• Work with relational and lakehouse systems including PostgreSQL and Delta Lake.
• Define and enforce best practices in data governance data quality security and architecture.
• Collaborate with architects data scientists analysts and business teams to translate requirements into technical solutions.
• Troubleshoot production issues optimize performance and support continuous improvement of the data platform.
• Mentor junior engineers and contribute to building engineering standards and reusable components.

Required Skills : -

Preferred Skills :

Skills : - Java Python Spark

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1