Talent.com
Cloud Data Engineer
Cloud Data EngineerGOVX • CA, US
Cloud Data Engineer

Cloud Data Engineer

GOVX • CA, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

POSITION DESCRIPTION

The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modernized data architecture. The position will be responsible for day-to-day data collection, transportation, maintenance / curation, and access to the GOVX corporate data assets. The Cloud Data Engineer will work cross-functionally across the enterprise to centralize data and standardize it for use by business reporting, machine learning, AI, data science, and other stakeholders. This position plays a critical role in increasing awareness about available data and democratizing access to it across GOVX and our data partners.

This position will be under the supervision of the Business Intelligence Manager.

RESPONSIBLITIES

  • Supporting and modernizing existing data integrations.
  • Crafting and maintaining efficient data pipeline architecture.
  • Assembling large, complex data sets that meet business requirements.
  • Create and maintain optimal data pipeline / flow architecture.
  • Identifying, crafting, and implementing internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Partner with business analysts, data scientists, and IT teams to translate business requirements into scalable data solutions using Fabric, Spark, using Delta Lake. Develop Spark notebooks for both batch and streaming ETL pipelines leveraging Delta Lake.
  • Implement and optimize Delta Lake features including schema enforcement, schema evolution, and time travel for robust data management. Optimize Delta Lake tables for performance using Z-ordering, compaction, and partitioning strategies.
  • Working with the team to strive for clean and meaningful data, and greater functionality and flexibility within the team’s data systems.
  • Design processes supporting data transformation, data structures, metadata, dependency, and workload management.

Requirements

SKILL / REQUIREMENTS

  • Hands-on experience developing, debugging, and optimizing Spark notebooks for ETL and analytics in Microsoft Fabric and Azure.
  • Deep expertise in Microsoft Fabric, Dataflows Gen2, and Power BI integration.
  • Hands-on experience with Delta Lake table management, including schema evolution, versioning, and data compaction
  • Experience with Data Lakehouse and Medallion Architecture.
  • Experience with CI / CD and version control using Git.
  • Advanced SQL and NoSQL query authoring; Python and Spark scripting.
  • Proficiency with object-oriented / object function scripting languages : Python, Spark, etc.
  • Proficiency with Metadata-Driven Design and JSON.
  • Experience working with streams such as Event Hubs and Event Driven Architectures.
  • Experience building, maintaining, and optimizing ‘big data’ data pipelines, architectures, and data sets.
  • Experience cleaning, testing, and evaluating data quality from a wide variety of ingestible data sources.
  • Knowledge Microsoft Power Platform including Copilot Studio and Power Apps.
  • Strong collaboration and communication skills with business and technical teams.
  • SUPERVISORY RESPONSIBILITY

    This position has no supervisory responsibilities.

    WORK ENVIRONMENT

    This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines. This role occasionally must lift and carry the office equipment. Occasional evening, night and weekend shifts are required.

    Work Location

    Due to state law and tax implications, remote work candidates must live and work in one of the following states : California, Texas, Washington, Florida, Tennessee, New York, or Colorado.

    PHYSICAL / MENTAL DEMANDS

  • Physical - This is a sedentary role.
  • Mental – Problem solving, making decisions, interpreting data, organize, read / write.
  • Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
  • TRAVEL

    Annual travel to the San Diego office headquarters is expected for this position.

    PREFERRED EDUCATION AND EXPERIENCE

  • Bachelor’s degree or equivalent experience.
  • 7+ years of proven experience deploying and maintaining always-on data services.
  • 2+ years building and maintaining Spark notebook-based pipelines in Microsoft Fabric.
  • 2+ years of experience working with Microsoft Fabric
  • 2+ years of experience working with Microsoft Azure
  • 2+ years of experience with Delta Lake.
  • 1+ years of experience with SQL Server.
  • Benefits

  • Paid Time Off, Paid Sick Leave, Paid Holidays
  • Competitive Medical, Dental, Vision, Short Term Disability, and Life Insurance
  • 401(k) plan with discretionary match available
  • Flexible Spending Account (FSA), Health Savings Account (HSA)
  • Voluntary benefits including Critical Illness, Group Accident, and Voluntary Life
  • Employee Referral Program
  • Exposure to a growing ecommerce company
  • Discounts on the GOVX website
  • Salary Range

    $120,000 - 140,000 Annually

    AAP / EEO Statement

    EOE. Veterans / Disabled.  Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

    Position will require successful completion of a background check and drug testing prior to starting employment.

    About GOVX, Inc.

    Savings for Those Who Serve

    GOVX was founded in 2011 to offer exclusive benefits to those who serve our country. The GOVX membership is comprised of current and former members of the United States military, law enforcement, firefighting, medical services, and government personnel. We are dedicated to supporting these communities and to offering unique value to our members, while delivering an authentic platform for brands to reach our growing customer base. As the largest and fastest growing digital platform serving this deserving audience, we are committed to stretching the limits of ecommerce to deliver the best assortment for our members’ on-duty and off-duty needs.

    serp_jobs.job_alerts.create_a_job

    Cloud Data Engineer • CA, US

    Job_description.internal_linking.related_jobs
    Remote Backend Software Engineer : Python - AI Trainer ($80-$120 per hour)

    Remote Backend Software Engineer : Python - AI Trainer ($80-$120 per hour)

    Mercor • Tulare, California, US
    serp_jobs.filters.remote
    serp_jobs.job_card.part_time
    Mercor is hiring experienced Python Engineers • • to support a variety of high-impact research collaborations with leading AI labs. Freelancers will help improve AI systems through work extending codi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Remote Side Hustle Developer

    Remote Side Hustle Developer

    Finance Buzz • Visalia, California, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    This position is for individuals who want to develop a side income stream while still working full time.You will test different small-scale remote opportunities, learn what works, and grow what pro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Analytics Architect

    Data Analytics Architect

    Staffingine LLC • CA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : Data Analytics Architect Job Location : Remote Job Type : Contract serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Remote Sales & Trading Associate - AI Trainer ($50-$60 / hour)

    Remote Sales & Trading Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Tulare, California
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Tech Lead, Data & Inference Engineer

    Tech Lead, Data & Inference Engineer

    Catalyst Labs • California, California, USA
    serp_jobs.job_card.full_time
    A fast moving and venture backed advertising technology startup based in San Francisco.They have raised twelve million dollars in funding and are transforming how business to business marketers rea...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    OpenSystem Python Data Engineer

    OpenSystem Python Data Engineer

    Qualis1 Inc • CA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : Technology Architect | OpenSystem | Python - OpenSystem Python Data Engineerserp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Junior Cloud Engineer

    Junior Cloud Engineer

    Openkyber • CA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Position Summary : The Cloud Solutions Manager (Azure) will play a critical role in managing and optimizing our enterprise collaboration, identity, and MS cloud platforms.This rol...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Staff Data Scientist

    Staff Data Scientist

    Take-two Interactive Software • California, United States, California, United States
    serp_jobs.job_card.full_time
    Headquartered in New York City, Take-Two Interactive Software, Inc.We develop and publish products principally through Rockstar Games, 2K, and Zynga. Our strategy is to create hit entertainment expe...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior AI Engineer I, Literacy (24 months fixed-term)

    Senior AI Engineer I, Literacy (24 months fixed-term)

    Jobgether • California, United States, California, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    This position is posted by Jobgether on behalf of Khan Academy.We are currently looking for a Senior AI Engineer I, Literacy (24 months fixed-term) in California (USA). This is an exciting opportuni...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Site Reliability Engineer

    Senior Site Reliability Engineer

    Govx • California, United States, California, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    GOVX is seeking an experienced Senior Site Reliability Engineer (SRE) to ensure the reliability, scalability, and performance of our production systems through automation, observability, and operat...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Cloud MLOps Engineer

    Cloud MLOps Engineer

    Openkyber • CA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : : L2 Azure Cloud Engineer Job Location : : Phoenix, AZ (Onsite) AgreeYa is a global Systems Integrator and is seeking an experienced, Azu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • Tulare, California
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Financial Analyst

    Financial Analyst

    Jobot • Visalia, CA, US
    serp_jobs.job_card.permanent
    Construction Industry Financial Analyst in the Central Valley!.This Jobot Job is hosted by : Sunshine Pennington.Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Entry Product Support - No Experience

    Data Entry Product Support - No Experience

    GLOCPA • Visalia, California
    serp_jobs.job_card.full_time
    We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Cloud Platform Engineer

    Senior Cloud Platform Engineer

    Openkyber • CA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Location : Hybrid, Walnut Creek , CA- Weekly 3 days in office and 2 days remote.Position : Senior AI / ML Engineer Type : C2H-Contract TO Hire- This is not a C2C position - it's...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Cloud Consultant

    Cloud Consultant

    Noblesoft Technologies • California, California, USA
    serp_jobs.job_card.full_time
    Proficient in managing cloud infrastructure including deployment setup and upkeep.Skilled at monitoring cloud services optimizing performance and managing expenses. Able to diagnose and fix cloud-re...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Remote Database Architects (Professional, Scientific, and Technical Services) - AI Trainer ($100-$180 per hour)

    Remote Database Architects (Professional, Scientific, and Technical Services) - AI Trainer ($100-$180 per hour)

    Mercor • Visalia, California, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Mercor is recruiting • •Database Architects who work in the Professional, Scientific, and Technical Services • • as independent contractors working on a research project • •for one of the world’s top A...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Govx • California, United States, California, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modern...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted