Talent.com
Data Engineer - III
Data Engineer - IIISoftware Guidance and Assistance, Inc. • San Francisco, CA, United States
serp_jobs.error_messages.no_longer_accepting
Data Engineer - III

Data Engineer - III

Software Guidance and Assistance, Inc. • San Francisco, CA, United States
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer - III for a contract assignment with one of our premier Financial Services clients in San Francisco, CA .

Responsibilities :

  • Responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights.
  • They will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users.
  • Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform.
  • Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.
  • Deliver high-quality data products and services following Safe Agile Practices.
  • Proactively identify and resolve issues with data pipelines and analytical data stores.
  • Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability.
  • Employ a security-first, testing, and automation strategy, adhering to data engineering best practices.
  • Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools.
  • Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies.

Required Skills :

  • Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience.
  • 2+ years' experience with tools such as Databricks, Collibra, and Starburst.
  • 3+ years' experience with Python and PySpark.
  • Experience using Jupyter notebooks, including coding and unit testing.
  • Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling).
  • 2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
  • Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud.
  • Data engineering experience in AWS (any CFS2 / EDS) highlighting the services / tools used.
  • Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture.
  • Requires access to confidential supervisory information
  • #LI-HV1
  • SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission : to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values : customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

    serp_jobs.job_alerts.create_a_job

    Data Engineer Iii • San Francisco, CA, United States

    Job_description.internal_linking.related_jobs
    Staff Data Infra Engineer — Petabyte-Scale Robotics Pipelines

    Staff Data Infra Engineer — Petabyte-Scale Robotics Pipelines

    Watneyrobotics • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A cutting-edge robotics company in San Francisco is seeking an experienced software engineer to architect and build robust petabyte-scale data pipelines. Ideal candidates will have 7+ years of softw...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Kikoff • San Francisco, California, United States
    serp_jobs.job_card.full_time
    We are looking for a Data Engineer or Analytics Engineer to join our Data team.You will collaborate with the data scientist and engineers to design, build, and scale high-leverage data models, foun...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    2025037 Senior Data Engineer

    2025037 Senior Data Engineer

    John Deere • San Francisco, California, United States
    serp_jobs.job_card.full_time
    There are over 7 billion people on this planet.And by 2050, there will be 2 billion more.Making sure there is enough food, fiber and infrastructure for our rapidly growing world is what we're all a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove Technologies Inc. • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer (1043)

    Senior Data Engineer (1043)

    City and County of San Francisco • San Francisco, California, USA
    serp_jobs.job_card.full_time
    DataSF is seeking a Senior Data Engineer with 3 years of experience to join our growing team.Reporting to the Principal Data Engineer you will be instrumental in designing building and maintaining ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Duckbill • San Francisco, California, United States
    serp_jobs.job_card.full_time
    We are developing a SaaS product that simplifies financial planning and analysis of cloud billing data for large enterprises with complex cloud spending requirements. We're looking for a data engine...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Tanium • Emeryville, California, United States
    serp_jobs.job_card.full_time
    Tanium is expanding rapidly and is seeking a skilled and motivated Data Engineer with a strong focus on data integrations and ETL pipeline development. This role will play a critical part in designi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Xscion • San Francisco, California, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting valu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Infra Engineer for AI Pipelines (GCP)

    Senior Data Infra Engineer for AI Pipelines (GCP)

    Speechify • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    An innovative technology company located in San Francisco is seeking a skilled Software Engineer for their Data Infrastructure & Acquisition team. In this role, you'll scrape audio data and manage c...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Delphi • San Francisco, California, United States
    serp_jobs.job_card.full_time
    We are redefining how knowledge is shared.We are enabling anyone to transform their unique expertise into an interactive experience, a digital version of their mind : a dynamic reflection of their k...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior AI & Data Platform Engineer (Onsite)

    Senior AI & Data Platform Engineer (Onsite)

    Icon Ventures • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A leading technology firm in San Francisco is looking for a Staff AI & Data Platform Engineer to design and develop scalable machine learning infrastructure. This role involves cross-functional coll...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer - III (USC / GC on W2 only)

    Data Engineer - III (USC / GC on W2 only)

    VARITE INC • San Francisco, California, United States
    serp_jobs.job_card.permanent
    VARITE is looking for a qualified.Established in the Year 2000, VARITE is an award-winning minority business enterprise providing global consulting & staffing services to Fortune 1000 companies and...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Data Platform Engineer II : Pipelines & Cloud Infra

    Data Platform Engineer II : Pipelines & Cloud Infra

    Australian Competition and Consumer Commission • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A leading technology firm in San Francisco is seeking a talented Software Engineer to join its data engineering and infrastructure team. You will design and build scalable data pipelines and manage ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Visa • Foster City, California, United States
    serp_jobs.job_card.full_time
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    Axon • San Francisco, California, United States
    serp_jobs.job_card.full_time
    Join Axon and be a Force for Good.At Axon, we’re on a mission to Protect Life.We’re explorers, pursuing society’s most critical safety and justice issues with our ecosystem of devices and cloud sof...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Infrastructure Engineer II — Scale Data Pipelines

    Data Infrastructure Engineer II — Scale Data Pipelines

    Aurora • San Francisco, CA, United States
    serp_jobs.job_card.full_time
    A pioneering technology company in San Francisco is seeking a skilled Software Engineer to enhance their data engineering and infrastructure team. In this role, you will design, build, and maintain ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Engineer III Analytics

    Software Engineer III Analytics

    Guidewire • San Mateo, California, USA
    serp_jobs.job_card.full_time +1
    At Guidewire we offer a dynamic work environment that combines excellent career opportunities a rational and meritocratic company culture and high quality software products.Our commitment to innova...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Rokt • San Francisco, California, United States
    serp_jobs.job_card.full_time
    We are Rokt, a hyper-growth ecommerce leader.Rokt is the global leader in ecommerce, unlocking real-time relevance in the moment that matters most. Rokt’s AI Brain and ecommerce Network powers billi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted