Staff Software Engineer, Online Database Infrastructure – Ingestionairbnb, Inc. • San Francisco, CA, United States
Staff Software Engineer, Online Database Infrastructure – Ingestion
airbnb, Inc. • San Francisco, CA, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_descriptionBe an expert in building and operating a data ingestion system that enables offline accessing and processing of online data at Airbnb in the form of (but not limited to) DB snapshots into the warehouse and near real time change data capture (CDC) events. Be hands‑on (code, design, test) and collaborate with cross team partners (internal customers, dependencies and leadership) to deliver on multi-month projects in a timely fashion. Lead a team of developers to deliver multi‑quarter cross functional projects. Stay up-to-date with the latest developments in data ingestion systems and evaluate and incorporate new technologies and methodologies to improve the existing data ingestion architecture / solution. Influence the team’s and organization’s long‑term roadmap and strategy. Mentor and coach team members, providing guidance and support to enhance their skills and technical standards in the team. Raise operational standards by effectively and proactively identifying, debugging and fixing operational issues. Be part of the oncall rotation for the Ingestion team. 9+ years of experience building and operating large scale core backend distributed systems. Hands on experience building and operating large scale online distributed databases and offline data ingestion pipelines to export data from underlying storage. Familiarity with internals of distributed databases and offline data warehouse systems is a must. Strong cross team collaboration and written and verbal communication skills and capable of influencing stakeholders and conveying complex technical concepts effectively. Ability to provide technical leadership, mentorship and guiding teams on best practices around data ingestion systems. Ability to own and dive deeply in a complex code base and knack for writing clean, readable, testable, maintainable code. Considerable experience working in either Java, Scala or Python and familiarity with SPARK and Kafka. Demonstrate strong ownership and ability to effectively plan multi month projects and deliver them in a timely manner. Experience with AWS and / or GCP. Experience working with Flink, K8s, Airflow, AWS Aurora or TiDB. Experience working with Iceberg and generating incremental Iceberg DB snapshots.
Staff Software Engineer, Online Database Infrastructure - Ingestion
Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.
The Community You Will Join :
- The mission of the Ingestion team in the Online Database Infrastructure org is to provide a managed, reliable, performant and scalable platform for exporting data out of Airbnb’s online databases for offline processing. The team currently builds and operates two managed solutions - one for near real time access to change logs (CDC) and another to provide periodic mutation and full table snapshots.
- As a member of this team you would be working with talented engineers on cutting edge technologies to help support Airbnb’s business. You will be the resident expert on the online data exports platform and guide and collaborate with our internal product teams to effectively use the platform.
The Difference You Will Make :
Your Expertise :
Nice to Haves
Our Commitment To Inclusion & Belonging :
Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively‑led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply.
We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at : reasonableaccommodations@airbnb.com . Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process.
We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application.
How We'll Take Care of You :
Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as : training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
#J-18808-Ljbffr
serp_jobs.job_alerts.create_a_job
Software Engineer Infrastructure • San Francisco, CA, United States
Job_description.internal_linking.related_jobs
Scale GP is building the next generation of enterprise‑grade Generative AI products.Our platform provides APIs for knowledge retrieval, inference, and evaluation, enabling customers to build and de...serp_jobs.internal_linking.show_more
Staff Software Engineer, Database Systems.Zilliz is a fast-growing startup developing the industrys leading vector database company for enterprise-grade AI.
Founded by the engineers behind Milvus, t...serp_jobs.internal_linking.show_more
Demandbase is the only pipeline AI platform that empowers GTM teams to automate growth at scale.With a unified view of data, insights, actions, and outcomes, B2B enterprises can seamlessly align an...serp_jobs.internal_linking.show_more
Fivetran is building data pipelines to power the modern data stack for thousands of companies.Fivetran is looking for a Senior Staff Software Engineer enthusiastic to join our fast-growing company....serp_jobs.internal_linking.show_more
Senior or Staff Software Engineer, Database Engineer.Senior or Staff Software Engineer, Database Engineer.TRM Labs is a blockchain intelligence company committed to fighting crime and creating a sa...serp_jobs.internal_linking.show_more
You are an experienced software engineer who thrives on building large scale computation platforms.You have deep expertise in backend systems that orchestrate workloads and route requests efficient...serp_jobs.internal_linking.show_more
Scale GP is building the next generation of enterprise-grade Generative AI products.Our platform provides APIs for knowledge retrieval, inference, and evaluation, enabling customers to build and de...serp_jobs.internal_linking.show_more
Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, spe...serp_jobs.internal_linking.show_more
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for users and society.
We are building a rapidly growing team of researchers, engineer...serp_jobs.internal_linking.show_more
Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experience.Our AI agents provide intelligent, human‑like responses across chat, email, and voi...serp_jobs.internal_linking.show_more
Staff Software Engineer, Infrastructure.Building at Check : At Check, we make paying people simple.In doing that, we’re not just building our own business—we’re building payroll businesses together ...serp_jobs.internal_linking.show_more
At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way.Our $1B+ learning platform serves tens of millions of students every month, includin...serp_jobs.internal_linking.show_more
Tellius enables organizations to get faster insights and .Any user can ask any question across billions of records via a ChatGPT-like interface, understand “why” metrics change via AI insights that...serp_jobs.internal_linking.show_more
AI can be a powerful tool for good in the world – at Altana we apply AI to the world’s largest organized body of supply chain data to power a more resilient, more secure, and more sustainable model...serp_jobs.internal_linking.show_more
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patients data, processing orders and prescr...serp_jobs.internal_linking.show_more
Rippling is the first way for businesses to manage all of their HR & IT—payroll, benefits, computers, apps, and more—in one unified workforce platform.
By connecting every business system to one sou...serp_jobs.internal_linking.show_more
Nimble is a robotics and AI company inventing and scaling autonomous logistics with intelligent robots to enable fast, efficient, and sustainable commerce.
We’re developing generalized robot intelli...serp_jobs.internal_linking.show_more
Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time.Omada Health is a digital care provider that empowers people to achieve their health goals through s...serp_jobs.internal_linking.show_more
Staff Infrastructure Software Engineer, Enterprise AI
Scale AI • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff Software Engineer, Database Systems
Zilliz • Redwood City, California, United States, 94061
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days
Staff Database Platform Engineer
Demandbase • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Staff Software Engineer
Fivetran • Oakland, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Senior Software Engineer, Data Infrastructure (RDBMS)
TRM Labs • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Staff Software Engineer, Compute
Fal • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Staff Infrastructure Software Engineer, Enterprise AI
Scale AI, Inc. • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff / Senior Staff Software Engineer - Cloud Hypervisor R&D
Crusoe Energy Systems LLC • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Staff+ Software Engineer - Databases
Anthropic • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff Software Engineer, Infrastructure
Decagon • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff Software Engineer, Infrastructure
Check Into Cash • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff Platform Engineer – Database Systems
Icon Ventures • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff Software Engineer
Tellius • San Francisco, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Staff Software Engineer
Altana AI • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff Software Engineer - AI Agent Infrastructure (Healthcare)
Honey Health • San Francisco, CA, US
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Staff Software Engineer - Data Cloud
Rippling • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Staff Software Engineer - Infrastructure
Nimble Robotics • San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Staff Software Engineer
Omada Health • South San Francisco, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted