Senior Data Engineer (San Francisco)Sigmaways Inc • San Francisco, CA, United States
Senior Data Engineer (San Francisco)
Sigmaways Inc • San Francisco, CA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_descriptionBachelors degree in Computer Science, Information Systems, or related field (or equivalent experience). At least 3 years of experience with Python and PySpark, including Jupyter notebooks and unit testing. At least 2 years of experience with Databricks, Collibra, and Starburst. Proven work with relational and NoSQL databases, including STAR and dimensional modeling approaches. Hands-on experience with modern data stacks : object stores (S3), Spark, Airflow, lakehouse architectures, and cloud warehouses (Snowflake, Redshift). Strong background in ETL and big data engineering (on-prem and cloud). Work within enterprise cloud platforms (CFS2, Cloud Foundational Services 2 / EDS) for governance and compliance. Experience building end-to-end pipelines for structured, semi-structured, and unstructured data using Spark.
If youre hands on with modern data platforms, cloud tech, and big data tools and you like building solutions that are secure, repeatable, and fast, this role is for you.
As a Senior Data Engineer, you will design, build, and maintain scalable data pipelines that transform raw information into actionable insights. The ideal candidate will have strong experience across modern data platforms, cloud environments, and big data technologies, with a focus on building secure, repeatable, and high-performing solutions.
Responsibilities :
- Design, develop, and maintain secure, scalable data pipelines to ingest, transform, and deliver curated data into the Common Data Platform (CDP).
- Participate in Agile rituals and contribute to delivery within the Scaled Agile Framework (SAFe).
- Ensure quality and reliability of data products through automation, monitoring, and proactive issue resolution.
- Deploy alerting and auto-remediation for pipelines and data stores to maximize system availability.
- Apply a security first and automation-driven approach to all data engineering practices.
- Collaborate with cross-functional teams (data scientists, analysts, product managers, and business stakeholders) to align infrastructure with evolving data needs.
- Stay current on industry trends and emerging tools, recommending improvements to strengthen efficiency and scalability.
Qualifications :
serp_jobs.job_alerts.create_a_job
Data Engineer • San Francisco, CA, United States
Job_description.internal_linking.related_jobs
Midjourney is a research lab exploring new mediums to expand the imaginative powers of the human species.We are a small, self-funded team focused on design, human infrastructure, and AI.We have no ...serp_jobs.internal_linking.show_more
We are actively searching for a Data Infrastructure Engineer to join our team on a permanent basis.In this founding engineer role you will focus on building next-generation data infrastructure for ...serp_jobs.internal_linking.show_more
A pioneering tech firm is seeking a Data Engineer to build data infrastructures that transform massive amounts of drone data into actionable insights.
The ideal candidate has strong software and dat...serp_jobs.internal_linking.show_more
Were looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You ...serp_jobs.internal_linking.show_more
Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...serp_jobs.internal_linking.show_more
A leading analytics platform in San Francisco is seeking a Senior Software Engineer in Data Engineering.The role involves building data pipelines and collaborating with cross-functional teams to en...serp_jobs.internal_linking.show_more
A leading digital platform is seeking a senior software engineer to enhance its data platform in San Francisco.In this hybrid role, you will collaborate across teams, tackle data challenges, and de...serp_jobs.internal_linking.show_more
A leading customer relationship management company in San Francisco is looking for an experienced software engineer with a strong data engineering background.
The role involves designing high-throug...serp_jobs.internal_linking.show_more
Senior Data Engineer page is loaded## Senior Data Engineerlocations : San Francisco, CA, USA : AMER - United States - Washington - Offsite / Home : AMER - United States - California - Offsite / Home...serp_jobs.internal_linking.show_more
PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...serp_jobs.internal_linking.show_more
A financial services company in San Francisco seeks a Distinguished Data Engineer to lead innovation in data architecture and management.
The role involves building critical data solutions, mentorin...serp_jobs.internal_linking.show_more
A technology firm focused on computer vision seeks a Senior Software Engineer in San Francisco, California.This role involves developing and maintaining robust data systems using AWS technologies.C...serp_jobs.internal_linking.show_more
Fluency is enabling the autonomous Enterprise.You're needed to help pioneer a new software category that will change how enterprises work.
Welcome to the data layer of the future.Fluency is looking ...serp_jobs.internal_linking.show_more
Youll work closely with engineering, analytics, and product teams to ensure data is accurate, accessible, and efficiently processed across the organization.
Design, develop, and maintain scalable da...serp_jobs.internal_linking.show_more
A leading technology firm in San Francisco is looking for a Staff AI & Data Platform Engineer to design and develop scalable machine learning infrastructure.
This role involves cross-functional coll...serp_jobs.internal_linking.show_more
Ellipsis Health is creating cutting-edge AI / ML products that solve healthcare staffing issues and administrative burdens using conversational AI and our patented voice biomarker technology in the d...serp_jobs.internal_linking.show_more
A leading AI productivity company is seeking a Senior Engineer for its Data Platform team in San Francisco.You will architect and develop systems for handling billions of daily events, ensuring sec...serp_jobs.internal_linking.show_more
We envision a world where novel drugs and therapies reach patients in months, not years, accelerating breakthroughs that save lives.
Mithrl is building the worlds first commercially available AI Co-...serp_jobs.internal_linking.show_more
Data Engineer (San Francisco)
Midjourney • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Data Platform Engineer / AI Workloads (San Francisco)
The Crypto Recruiters • San Francisco, CA, United States
serp_jobs.job_card.permanent
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Data Platform Engineer — AI-Driven, Scalable Pipelines
Booster • San Mateo, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Lead Data Engineer (San Francisco)
Mentor Talent Acquisition • San Francisco, CA, US
serp_jobs.job_card.part_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Data Engineer, Data Lake & Governance
Gridware • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Data Engineer, Growth Platform & Pipelines
Mixpanel • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Data Platform Engineer - Hybrid SF
FATMAP • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
Senior Data & ML Platform Engineer
Salesforce, Inc. • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Principal Data Engineer
Autodesk, Inc. • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
Senior Data Engineer
PG Forsta • Emeryville, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Senior Data Engineer, Card Data Platform
Capital One • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Data Platform Engineer — Scalable AWS Data Pipelines
Hayden AI Technologies, Inc. • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Data Engineer (San Francisco)
Fluency • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Data Engineer (San Francisco)
Odiin. • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior AI & Data Platform Engineer (Onsite)
Icon Ventures • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Data Platform Engineer
Ellipsis Health • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Data Platform Engineer : Scale BillionEvent Pipelines
Superhuman Labs, Inc. • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Data Engineer - Scientific Data Ingestion (San Francisco)
Mithrl • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted