Talent.com
Cloud Data Engineer
Cloud Data EngineerGovx • New York, New York, United States
Cloud Data Engineer

Cloud Data Engineer

Govx • New York, New York, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
job_description.job_card.job_description

POSITION DESCRIPTION

The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modernized data architecture. The position will be responsible for day-to-day data collection, transportation, maintenance / curation, and access to the GOVX corporate data assets. The Cloud Data Engineer will work cross-functionally across the enterprise to centralize data and standardize it for use by business reporting, machine learning, AI, data science, and other stakeholders. This position plays a critical role in increasing awareness about available data and democratizing access to it across GOVX and our data partners.

This position will be under the supervision of the Business Intelligence Manager.

RESPONSIBLITIES

  • Supporting and modernizing existing data integrations.
  • Crafting and maintaining efficient data pipeline architecture.
  • Assembling large, complex data sets that meet business requirements.
  • Create and maintain optimal data pipeline / flow architecture.
  • Identifying, crafting, and implementing internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Partner with business analysts, data scientists, and IT teams to translate business requirements into scalable data solutions using Fabric, Spark, using Delta Lake. Develop Spark notebooks for both batch and streaming ETL pipelines leveraging Delta Lake.
  • Implement and optimize Delta Lake features including schema enforcement, schema evolution, and time travel for robust data management. Optimize Delta Lake tables for performance using Z-ordering, compaction, and partitioning strategies.
  • Working with the team to strive for clean and meaningful data, and greater functionality and flexibility within the team’s data systems.
  • Design processes supporting data transformation, data structures, metadata, dependency, and workload management.

SKILL / REQUIREMENTS

  • Hands-on experience developing, debugging, and optimizing Spark notebooks for ETL and analytics in Microsoft Fabric and Azure.
  • Deep expertise in Microsoft Fabric, Dataflows Gen2, and Power BI integration.
  • Hands-on experience with Delta Lake table management, including schema evolution, versioning, and data compaction
  • Experience with Data Lakehouse and Medallion Architecture.
  • Experience with CI / CD and version control using Git.
  • Advanced SQL and NoSQL query authoring; Python and Spark scripting.
  • Proficiency with object-oriented / object function scripting languages : Python, Spark, etc.
  • Proficiency with Metadata-Driven Design and JSON.
  • Experience working with streams such as Event Hubs and Event Driven Architectures.
  • Experience building, maintaining, and optimizing ‘big data’ data pipelines, architectures, and data sets.
  • Experience cleaning, testing, and evaluating data quality from a wide variety of ingestible data sources.
  • Knowledge Microsoft Power Platform including Copilot Studio and Power Apps.
  • Strong collaboration and communication skills with business and technical teams.
  • SUPERVISORY RESPONSIBILITY

    This position has no supervisory responsibilities.

    WORK ENVIRONMENT

    This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines. This role occasionally must lift and carry the office equipment. Occasional evening, night and weekend shifts are required.

    Work Location

    Due to state law and tax implications, remote work candidates must live and work in one of the following states : California, Texas, Washington, Florida, Tennessee, New York, or Colorado.

    PHYSICAL / MENTAL DEMANDS

  • Physical - This is a sedentary role.
  • Mental – Problem solving, making decisions, interpreting data, organize, read / write.
  • Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
  • TRAVEL

    Annual travel to the San Diego office headquarters is expected for this position.

    PREFERRED EDUCATION AND EXPERIENCE

  • Bachelor’s degree or equivalent experience.
  • 7+ years of proven experience deploying and maintaining always-on data services.
  • 2+ years building and maintaining Spark notebook-based pipelines in Microsoft Fabric.
  • 2+ years of experience working with Microsoft Fabric
  • 2+ years of experience working with Microsoft Azure
  • 2+ years of experience with Delta Lake.
  • 1+ years of experience with SQL Server.
  • Paid Time Off, Paid Sick Leave, Paid Holidays
  • Competitive Medical, Dental, Vision, Short Term Disability, and Life Insurance
  • 401(k) plan with discretionary match available
  • Flexible Spending Account (FSA), Health Savings Account (HSA)
  • Voluntary benefits including Critical Illness, Group Accident, and Voluntary Life
  • Employee Referral Program
  • Exposure to a growing ecommerce company
  • Discounts on the GOVX website
  • Salary Range

    $120,000 - 140,000 Annually

    AAP / EEO Statement

    EOE. Veterans / Disabled.  Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

    Position will require successful completion of a background check and drug testing prior to starting employment.

    About GOVX, Inc.

    Savings for Those Who Serve

    GOVX was founded in 2011 to offer exclusive benefits to those who serve our country. The GOVX membership is comprised of current and former members of the United States military, law enforcement, firefighting, medical services, and government personnel. We are dedicated to supporting these communities and to offering unique value to our members, while delivering an authentic platform for brands to reach our growing customer base. As the largest and fastest growing digital platform serving this deserving audience, we are committed to stretching the limits of ecommerce to deliver the best assortment for our members’ on-duty and off-duty needs.

    serp_jobs.job_alerts.create_a_job

    Cloud Data Engineer • New York, New York, United States

    Job_description.internal_linking.related_jobs
    Senior AWS Cloud Engineer / Lead (W2)New York City, NY

    Senior AWS Cloud Engineer / Lead (W2)New York City, NY

    Career Mentors, LLC • NEW YORK, NY, US
    serp_jobs.job_card.full_time
    Job Title : Senior AWS Cloud Engineer / Lead (W2).New York City, NY (Local Candidates Only).We are seeking an experienced and highly skilled. Senior AWS Cloud Engineer / Lead.This is a hands-on engin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Cloud Data Engineer

    Cloud Data Engineer

    Brains Workgroup, Inc. • New York, New York, United States
    serp_jobs.job_card.permanent
    Our client, a major bank in New York City, is looking for Cloud Data Engineer.Permanent position with competitive compensation package (base range is 135-145K), excellent benefits, and target bonus...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Cloud AWS Engineer

    Cloud AWS Engineer

    Stefanini Group • East Rutherford, New Jersey, USA
    serp_jobs.job_card.full_time
    Stefanini is looking for Cloud AWS Engineer-Remote.For quick apply please contact Ayush Dwivedi- Ph : / .This position is for a role within the service management team to assist and train the team me...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Data Platform Engineer

    Cloud Data Platform Engineer

    Chubb • Jersey City, New Jersey, United States
    serp_jobs.job_card.full_time +1
    Chubb is looking for a Azure Platform Engineering Professional with a Bachelor’s Degree to join our Global Data Platform team. This is a permanent full-time position and a compelling opportunity to ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Azure Cloud Engineer

    Azure Cloud Engineer

    Match Point Solutions • New York City, New York, USA
    serp_jobs.job_card.full_time
    MatchPoint Solutions is a fast-growing young energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like Uber Robinhood Netfl...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Gotham Technology Group • New York, New York, United States
    serp_jobs.job_card.permanent
    Enterprise Data Management – Data Cloud, Senior Developer I.The Data Engineering team oversees the organization's central data infrastructure, which powers enterprise-wide data products and advance...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer, Platform

    Data Engineer, Platform

    Basis Research Institute • New York, NY, United States
    serp_jobs.job_card.full_time
    AI research organization with two mutually reinforcing goals.This means to establish the mathematical principles of what it means to reason, to learn, to make decisions, to understand, and to expla...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    10a Labs • New York, New York, United States
    serp_jobs.job_card.full_time
    Labs is an applied research and AI security company trusted by AI unicorns, Fortune 10 companies, and U.We combine proprietary technology, deep expertise, and multilingual threat intelligence to de...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Cloud Data Architect

    Cloud Data Architect

    Tiger Analytics • Jersey City, NJ, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Tiger Analytics is an advanced analytics consulting firm.We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data.Our consultants b...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Senior Data Engineer, Data Infrastructure

    Senior Data Engineer, Data Infrastructure

    Zocdoc • New York, New York, United States
    serp_jobs.job_card.full_time
    Healthcare should work for patients, but it doesn’t.In their time of need, they call down outdated insurance directories. Then wait weeks for the privilege of a visit.Then wait in a room solely desi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Cloud Infrastructure Engineer

    Cloud Infrastructure Engineer

    Clover Health • Jersey, New Jersey, USA
    serp_jobs.job_card.full_time
    We value diversity in backgrounds and in experiences.Healthcare is a universal concern and we need people from all backgrounds and swaths of life to help build the future of healthcare.Clovers eng...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Infrastructure engineer

    Cloud Infrastructure engineer

    Acumenz Consulting • New York City, NY, US
    serp_jobs.job_card.full_time
    Role Cloud Infrastructure engineer / cloud Ops Engineer Onsite 5 days Contract to Hire (C2H).Exp : 5+ years Mandatory Skills : AWS Lambda,AWS S3,AWS Database Service,AWS Infra Services,AWS VPC,AWS E...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Coast • New York, New York, United States
    serp_jobs.job_card.full_time
    Coast is re-imagining the trillion-dollar U.B2B card payments infrastructure, with a focus on the country’s 500,000 commercial fleets, 40 million commercial vehicles, and many million commercial dr...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Cloud Engineer

    Cloud Engineer

    Zone IT Solutions • New York, NY, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    We are looking for a Cloud Engineer, where you will be a key player in shaping our cloud strategy and enhancing the services we provide to our clients. In this role, you will design, implement, and ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Senior Software Engineer – Cloud Data Platform

    Senior Software Engineer – Cloud Data Platform

    Disneyland Hong Kong • New York, NY, United States
    serp_jobs.job_card.full_time
    A global entertainment company seeks a Senior Software Engineer to drive data platform innovation.The role involves developing critical tools for engineering teams, ensuring operational excellence,...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Fanduel • New York, New York, United States
    serp_jobs.job_card.full_time
    Our roster has an opening with your name on it.At FanDuel, our data platform underpins critical business operations that need to run with maximum efficiency and scalability.As our business continue...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Cloud & AI Applications Engineer

    Cloud & AI Applications Engineer

    Map Ssg • New York City, New York, USA
    serp_jobs.job_card.full_time
    The Enterprise Applications team is seeking a motivated technically savvy and business-oriented professional to serve as the initial point of technical contact for the firms cloud-based and AI-powe...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud & AI Applications Engineer

    Cloud & AI Applications Engineer

    Cleary Gottlieb Steen & Hamilton LLP • New York City, New York, USA
    serp_jobs.job_card.full_time
    Cleary Gottlieb is a pioneer in globalizing the legal profession.We have 14 offices in major financial centers around the world but we operate as a single integrated global partnership and not as a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted