Talent.com
Data Engineer - III
Data Engineer - IIISoftware Guidance and Assistance, Inc. • San Francisco, CA, United States
serp_jobs.error_messages.no_longer_accepting
Data Engineer - III

Data Engineer - III

Software Guidance and Assistance, Inc. • San Francisco, CA, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer - III for a contract assignment with one of our premier Financial Services clients in San Francisco, CA .

Responsibilities :

  • Responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights.
  • They will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users.
  • Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform.
  • Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.
  • Deliver high-quality data products and services following Safe Agile Practices.
  • Proactively identify and resolve issues with data pipelines and analytical data stores.
  • Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability.
  • Employ a security-first, testing, and automation strategy, adhering to data engineering best practices.
  • Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools.
  • Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies.

Required Skills :

  • Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience.
  • 2+ years' experience with tools such as Databricks, Collibra, and Starburst.
  • 3+ years' experience with Python and PySpark.
  • Experience using Jupyter notebooks, including coding and unit testing.
  • Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling).
  • 2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
  • Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud.
  • Data engineering experience in AWS (any CFS2 / EDS) highlighting the services / tools used.
  • Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture.
  • Requires access to confidential supervisory information
  • #LI-HV1
  • SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission : to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values : customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

    serp_jobs.job_alerts.create_a_job

    Data Engineer Iii • San Francisco, CA, United States

    Job_description.internal_linking.related_jobs
    Staff Data Infra Engineer — Petabyte-Scale Robotics Pipelines

    Staff Data Infra Engineer — Petabyte-Scale Robotics Pipelines

    Watneyrobotics • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A cutting-edge robotics company in San Francisco is seeking an experienced software engineer to architect and build robust petabyte-scale data pipelines. Ideal candidates will have 7+ years of softw...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Staff AI & Data Platform Engineer

    Staff AI & Data Platform Engineer

    Quizlet • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    About Quizlet : At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way. Our $1B+ learning platform serves tens of millions of students every ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Platform Engineer – AI / ML Pipelines

    Senior Data Platform Engineer – AI / ML Pipelines

    Amazon • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A leading technology company in San Francisco is seeking an experienced Data Engineer to join Ring's Decision Sciences Platform Team. You will design and maintain robust data pipelines, ensuring the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Engineer III

    Engineer III

    Rosendin • San Francisco, CA
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Whether you're a recent grad or a seasoned professional, you can experience meaningful career growth at Rosendin.Enjoy a true sense of ownership as you work with a proven industry leader on some of...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Senior Data Engineer, Data Lake & Governance

    Senior Data Engineer, Data Lake & Governance

    Gridware • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Data Engineer (San Francisco)

    Lead Data Engineer (San Francisco)

    Mentor Talent Acquisition • San Francisco, CA, US
    serp_jobs.job_card.part_time
    Were looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove Technologies Inc. • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Infra Engineer for AI Pipelines (GCP)

    Senior Data Infra Engineer for AI Pipelines (GCP)

    Speechify • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    An innovative technology company located in San Francisco is seeking a skilled Software Engineer for their Data Infrastructure & Acquisition team. In this role, you'll scrape audio data and manage c...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior AI & Data Platform Engineer (Onsite)

    Senior AI & Data Platform Engineer (Onsite)

    Icon Ventures • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A leading technology firm in San Francisco is looking for a Staff AI & Data Platform Engineer to design and develop scalable machine learning infrastructure. This role involves cross-functional coll...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Platform Engineer / AI Workloads (Alameda)

    Data Platform Engineer / AI Workloads (Alameda)

    The Crypto Recruiters • Alameda, CA, US
    serp_jobs.job_card.part_time +1
    We are actively searching for a Data Infrastructure Engineer to join our team on a permanent basis.In this founding engineer role you will focus on building next-generation data infrastructure for ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AWS Data Engineer Python, Dataiku

    AWS Data Engineer Python, Dataiku

    Compunnel, Inc. • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    We are looking for an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines using AWS native technologies. This role involves working closely with technical analysts...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Midjourney • San Francisco, California, United States
    serp_jobs.job_card.full_time
    Midjourney is a research lab exploring new mediums to expand the imaginative powers of the human species.We are a small, self-funded team focused on design, human infrastructure, and AI.We have no ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer - III (USC / GC on W2 only)

    Data Engineer - III (USC / GC on W2 only)

    VARITE INC • San Francisco, California, United States
    serp_jobs.job_card.permanent
    VARITE is looking for a qualified.Established in the Year 2000, VARITE is an award-winning minority business enterprise providing global consulting & staffing services to Fortune 1000 companies and...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Data Platform Engineer II : Pipelines & Cloud Infra

    Data Platform Engineer II : Pipelines & Cloud Infra

    Australian Competition and Consumer Commission • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A leading technology firm in San Francisco is seeking a talented Software Engineer to join its data engineering and infrastructure team. You will design and build scalable data pipelines and manage ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    Autodesk, Inc. • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Engineer page is loaded## Senior Data Engineerlocations : San Francisco, CA, USA : AMER - United States - Washington - Offsite / Home : AMER - United States - California - Offsite / Home...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Data Infrastructure Engineer II — Scale Data Pipelines

    Data Infrastructure Engineer II — Scale Data Pipelines

    Aurora • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A pioneering technology company in San Francisco is seeking a skilled Software Engineer to enhance their data engineering and infrastructure team. In this role, you will design, build, and maintain ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Platform Engineer II

    Platform Engineer II

    Amplitude • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Amplitude is the leading digital analytics platform, helping over 4,300 customers—including Atlassian, Burger King, NBCUniversal, Square, and Under Armour—build better products and digital experien...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Storage Engineer II — Hybrid & High-Impact AI Infra

    Cloud Storage Engineer II — Hybrid & High-Impact AI Infra

    Crusoe Energy Systems LLC • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Crusoe Energy Systems LLC is pioneering AI-based cloud infrastructure solutions and is looking for a Software Engineer to innovate within their cloud storage team. The ideal candidate will enhance p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted