Talent.com
Lead Data Engineer
Lead Data EngineerNess Digital Engineering • New York, NY, US
Lead Data Engineer

Lead Data Engineer

Ness Digital Engineering • New York, NY, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Description

Job Title : Lead Data Engineer / Data Architect

Location : New York City, NY; Secondary location - Boston, MA (Onsite – 5 days / week)

About the Role :

We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability, performance, and innovation. The ideal candidate combines deep technical expertise with strong leadership skills and a solid understanding of financial services data domains.

Key Responsibilities :

  • Lead the data architecture and engineering strategy , ensuring alignment with business and technology roadmaps.
  • Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
  • Partner with stakeholders to translate business requirements into scalable data solutions .
  • Performance Optimization : Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
  • Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
  • Data Quality Assurance : Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
  • Collaboration and Communication : Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
  • Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
  • Ensure compliance with data governance, security, and privacy standards.
  • Documentation : Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
  • Issue Resolution : Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.

Required Qualifications :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • 8+ years of experience in data engineering with a strong focus on Data Architecture , Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
  • Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
  • Proficiency in SQL and familiarity with data integration and ETL / ELT tools.
  • AWS Technologies (Glue, EMR)
  • Python for data engineering workflows
  • Strong understanding of data engineering design patterns
  • Strong problem-solving skills and the ability to work independently to meet deadlines.
  • Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Certifications in Snowflake or relevant data technologies.
  • Experience in the financial services sector, especially asset management / alternative investments, with an understanding of data security and compliance requirements.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and data orchestration tools (e.g., Apache Airflow).
  • Knowledge of data visualization tools (e.g., Tableau, Power BI).
  • Why Join Us :

    At Ness, you will work with diverse, talented professionals who are dedicated to making an impact through technology. We encourage applicants of all backgrounds to apply—even if you don’t meet every requirement, we’d love to connect with you if this role excites you. We’re committed to creating an inclusive workplace that celebrates each team member’s unique talents.

    With flexible remote options, diverse projects, and access to development resources, joining Ness means building a career that’s meaningful and impactful.

    Ready to Start Your Journey?

    serp_jobs.job_alerts.create_a_job

    Lead Data Engineer • New York, NY, US

    Job_description.internal_linking.related_jobs
    Lead Data Engineer

    Lead Data Engineer

    EXL • Jersey City, NJ, United States
    serp_jobs.job_card.full_time
    We are seeking a highly skilled.The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced envir...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    MetroPlus Health Plan • New York, NY, United States
    serp_jobs.job_card.full_time +1
    Water Street, 7th Floor, New York, NY 10004 .New Yorkers by uniting communities through care.We believe that Health care is a right, not a privilege. If you have compassion and a collaborative sp...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    DL Software Inc. • New York, NY, United States
    serp_jobs.job_card.full_time
    DL Software produces Godel, a financial information and trading terminal.This is a full-time, on-site role based in New York, NY, for a Data Engineer. The Data Engineer will design, build, and maint...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Data Engineer Data Architect

    Lead Data Engineer Data Architect

    TalentOla • New York City, New York, USA
    serp_jobs.job_card.full_time
    Partner with stakeholders to translate business requirements into.Performance Optimization : Optimize data pipelines for performance scalability and reliability including query tuning and resource m...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Haptiq • New York, NY, United States
    serp_jobs.job_card.full_time
    Haptiq is a leader in AI-powered enterprise operations, delivering digital solutions and consulting services that drive value and transform businesses. We specialize in using advanced technology to ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    IPG Mediabrands • New York, NY, United States
    serp_jobs.job_card.full_time
    KINESSO is the technology-driven performance marketing agency that sits at the very heart of IPG Mediabrands, providing actionable growth for both our agency partners and clients.We turn 'action' i...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    Nagarro • Any, Switzerland
    serp_jobs.job_card.full_time
    Architect and implement end-to-end data solutions using Microsoft Fabric.Define data ingestion transformation and modeling strategy using Lakehouse / Warehouse. Build scalable ETL / ELT pipelines using ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Brains Workgroup, Inc. • New York City, NY, US
    serp_jobs.job_card.permanent
    Our client, a major bank in New York City, is looking for Cloud Data Engineer.Permanent position with competitive compensation package (base range is 135-145K), excellent benefits, and target bonus...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Amalgamated Bank Of Ny • New York City, New York, USA
    serp_jobs.job_card.full_time
    We are looking for an experienced and highly skilled Data Engineer to join our Data Governance Team.The ideal candidate will have a strong background in data engineering with specific experience in...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations

    Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations

    Capital One • New York, NY, US
    serp_jobs.job_card.full_time +1
    Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations).Do you love building and pioneering in the technology space? Do you enjoy solving complex busin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer Matillion ETL

    Data Engineer Matillion ETL

    Noblesoft Technologies • Secaucus, New Jersey, USA
    serp_jobs.job_card.full_time
    Job Title : Data Engineer - Matillion ETL.Mandatory - Snowflake Matillion ETL.Job Description / Key Responsibilities : .We are looking for a skilled Data Engineer to join our team.The ideal candidate ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Fusemachines • New York, NY, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider.Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Lead Software Engineer- Data Analytics

    Lead Software Engineer- Data Analytics

    JPMorganChase • Jersey, New Jersey, USA
    serp_jobs.job_card.full_time
    We have an opportunity to impact your career and provide an adventure where you can push the limits of whats possible.Ready to push the limits of whats possible. Join us for a career-defining advent...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Valon Tech • New York City, New York, USA
    serp_jobs.job_card.full_time
    Valon is building the AI-native operating system for regulated finance starting with mortgage servicing.Were a Series C company backed by a16z transforming industries that others have written off a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    APN Consulting, Inc. • New York, New York, United States
    serp_jobs.job_card.full_time
    Job title : Lead Software Engineer.Duration : Fulltime / Contract to Hire.Location : New York, NY (Hybrid).The successful candidate will be a key member of the HR Technology team, responsible for develo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Northbound Executive Search • New York, New York, United States
    serp_jobs.job_card.full_time
    This role combines technical leadership with hands-on development, focusing on data architecture, pipeline design, and governance for high-quality, reliable financial data.You will be acting as a l...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    BHFT • New York City, New York, USA
    serp_jobs.job_card.full_time
    Data Engineering team is responsible for designing building and maintaining the Data Lake infrastructure including ingestion pipelines storage systems and internal tooling for reliable scalable acc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Cloud BC Labs • New York City, New York, USA
    serp_jobs.job_card.full_time
    Location : New York City NY (Onsite).Data Architecture Data Modelling Expert level SQL Python AWS Technologies (Glue) Snowflake and data engineering design patterns. Asset management Alternatives I...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted