Talent.com
Senior Software Engineer - Data Lakehouse Infrastructure
Senior Software Engineer - Data Lakehouse InfrastructureTRM Labs • Bronx, NY, United States
Senior Software Engineer - Data Lakehouse Infrastructure

Senior Software Engineer - Data Lakehouse Infrastructure

TRM Labs • Bronx, NY, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Software Engineer

TRM is on a mission to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime. We consider our business and our profit as a way to move towards our mission sustainably and at scale.

The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As a Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people.

The impact you'll have here :

  • Build highly reliable data services to integrate with dozens of blockchains.
  • Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
  • Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
  • Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability.
  • Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM's products.

What we're looking for :

  • Bachelor's degree (or equivalent) in Computer Science or a related field.
  • A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.
  • Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
  • Versatility that spans the entire spectrum of data engineering in one or more of the following areas :
  • In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.
  • Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
  • Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
  • Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.
  • Proven ability in loading, querying, and transforming extensive datasets
  • About the Team :

  • The Data Platform team is the funnel between all of TRM's data world and product world. We care about all layers of stack including petabyte of data stores, pipelines, and processes.
  • We have quite a big scope as a the team with new and exciting projects every quarter. As a result, we collaborate across the board with most teams at TRM.
  • We believe in async communication and are also not afraid to jump on a quick huddle if that helps to move things faster. We are both scrappy when the situation demands and also process-oriented when we need to achieve our OKRs.
  • We are always looking for people who can elevate the quality our tech and our execution. If you enjoy a remote-first and async friendly environment to achieve efficacy and efficiency at petabyte scale, our team could be a great pick for you!
  • Team members are based in the US across almost all timezones! Our on-call tends to be in EST / PST shift, whatever suits you best.
  • We do try to reserve some overlap in the day for meetings. Our north star - no IC spends more than 3-4 hours / week in meetings.
  • Learn about TRM Speed in this position :

  • Build scalable engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling / updating of clusters, etc.
  • Enable tasks to be faster next time and reducing dependency on a single person.
  • Identify ways to compress timelines using 80 / 20 principle. For instance, what does it take to be operational in a new environment? Identify the must have and nice to haves that are need to deploy our stack to be fully operation. Focus on must haves first to get us operational and then use future milestones to harden for customer readiness. We think in terms of weeks and not months.
  • Identify first version, a.k.a., skateboards for projects. For instance, build an observability dashboard within a week. Gather feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard.
  • About TRM's Engineering Levels :

    Engineer : Responsible for helping to define project milestones and executing small decision decisions independently with the appropriate tradeoffs between simplicity, readability, and performance. Provides mentorship to junior engineers, and enhances operational excellence through tech debt reduction and knowledge sharing.

    Senior Engineer : Successfully designs and documents system improvements and features for an OKR / project from the ground up. Consistently delivers efficient and reusable systems, optimizes team throughput with appropriate tradeoffs, mentors team members, and enhances cross-team collaboration through documentation and knowledge sharing.

    Staff Engineer : Drives scoping and execution of one or more OKRs / projects that impact multiple teams. Partners with stakeholders to set the team vision and technical roadmaps for one or more products. Is a role model and mentor to the entire engineering organization. Ensures system health and quality with operational reviews, testing strategies, and monitoring rigor.

    Life at TRM Labs

    Leadership Principles :

    Our Leadership Principles are foundational element of our strategy, guiding how we make decisions, how we treat each other, and how we behave day-to-day.

  • Impact-Oriented Trailblazer : We put customers first, driving for speed, focus, and adaptability.
  • Master Craftsperson : We prioritize speed, high standards, and distributed ownership.
  • Inspiring Colleague : We value humility, candor, and a one-team mindset.
  • Build a Career :

    Joining TRM means being part of a mission-driven team comprised of industry leaders. At TRM, you'll experience :

  • Purpose and Mission : Have a real-world impact, from disrupting terrorist networks to returning stolen funds.
  • Inspiring Colleagues : Collaborate with industry leaders and learn something new daily.
  • Personal Growth : We're not just using technology; we're inventing it and taking category-defining products to market.
  • Work Environment :

  • Remote First : Our HQ is online. Tools like Zoom and Slack ensure seamless collaboration, but we also value in-person interactions, organizing regular meetups and offsites for team bonding. Clear communication is key in our decentralized setup. With tools like Slack, Loom, and voice notes, we document meetings and decisions, promoting transparency and efficiency.
  • Ownership & TRM Speed : Small teams drive big goals at TRM. Every team member has significant ownership and responsibility, fostering an environment of initiative and direct impact. While there's no strict clocking in or out, we expect team members to balance personal schedules and team needs. We move "surprisingly fast" while maintaining a high bar in service of our customers and mission. This can feel both intense and rewarding. Our unique approach to projects emphasizes quick wins, rapid iterations, and constant feedback.
  • Diversity and Inclusion : Diversity at TRM encompasses backgrounds, experiences, and perspectives. Every day is an opportunity to learn from a colleague, whether they're a law enforcement expert or a tech pioneer.
  • Annual Company Offsite : Once a year, TRMers come together from around the world to attend a 1-week mandatory company offsite. This is designed to foster in-person relationships, creativity, and strategic alignment. Employee attendance is required of all TRMers.
  • Join Us :

    We're looking for team members who love building from the ground up and want to work hard in a fast-paced and ambitious environment. We are remote-first, with exceptionally talented team members located around the world. If you like solving tough

    serp_jobs.job_alerts.create_a_job

    Senior Software Engineer Infrastructure • Bronx, NY, United States

    Job_description.internal_linking.related_jobs
    Senior Software Engineer, Enterprise GenAI

    Senior Software Engineer, Enterprise GenAI

    Scale AI, Inc. • New York, NY, United States
    serp_jobs.job_card.full_time
    Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong enginee...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, Data

    Senior Software Engineer, Data

    Peregrine Corporation • New York, NY, United States
    serp_jobs.job_card.full_time
    Backed by leading investors from Silicon Valley, Peregrine supports public safety agencies across the country from Los Angeles to Louisville to Atlanta empowering public servants to improve operati...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    Semgrep • New York, NY, United States
    serp_jobs.job_card.full_time
    Senior Software Engineer, Infrastructure.San Francisco / New York / Boston / Denver.Semgrep is on a mission to make it expensive to exploit software. As the team behind the most popular SAST, we built the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data and Software Engineer

    Senior Data and Software Engineer

    Affinity Solutions • New York, NY, United States
    serp_jobs.job_card.full_time
    Affinity Solutions is the leading consumer purchase insights company.We provide a complete view of U.Our proprietary AI technology, Comet™, transforms these purchase signals into actionable insight...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Backend Software Engineer - Data Infrastructure (New York City, Los Angeles, or San Francisco

    Senior Backend Software Engineer - Data Infrastructure (New York City, Los Angeles, or San Francisco

    Regard • New York, New York, United States
    serp_jobs.job_card.full_time
    As a Senior Backend Software Engineer - Data Infrastructure at Regard, you’ll play a leading role in building our products. You’ll be responsible for designing and developing critical backend servic...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer (Infrastructure)

    Senior Software Engineer (Infrastructure)

    Owl • New York, NY, United States
    serp_jobs.job_card.full_time
    AI systems for high‑stakes, real‑world decisions.Our platform ingests and reasons over large, messy data to surface evidence with hard constraints around fairness, auditability, and low bias.The si...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    Anthropic • San Francisco, CA, New York City, NY, Seattle, WA, California, United States
    serp_jobs.job_card.full_time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer, Data Infrastructure

    Senior Software Engineer, Data Infrastructure

    The New York Times • New York, NY, United States
    serp_jobs.job_card.full_time
    Senior Software Engineer, Data Infrastructure.Join to apply for the Senior Software Engineer, Data Infrastructure role at The New York Times Company. Be among the first 25 applicants.Department : Sof...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Data & Integrations

    Senior Software Engineer, Data & Integrations

    SAGE • New York, NY, United States
    serp_jobs.job_card.full_time
    Sage is on a mission to improve care and quality of life for older adults, starting with those residing in senior living facilities. Falls are the leading cause of injury-related death among adults ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer Data Center Infrastructure Management API

    Senior Software Engineer Data Center Infrastructure Management API

    Bloomberg • New York, NY, United States
    serp_jobs.job_card.full_time
    Senior Software Engineer Data Center Infrastructure Management API.The team is at the forefront of Bloomberg's infrastructure management, crafting secure and reliable APIs that serve as the foundat...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    S&P Global • New York, NY, United States
    serp_jobs.job_card.full_time
    Kensho is S&P Global's hub for AI innovation and transformation.With expertise in machine learning, natural language processing, and data discovery, we develop and deploy novel solutions to innovat...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer, Data Infrastructure

    Senior Data Engineer, Data Infrastructure

    Zocdoc • New York, New York, United States
    serp_jobs.job_card.full_time
    Healthcare should work for patients, but it doesn’t.In their time of need, they call down outdated insurance directories. Then wait weeks for the privilege of a visit.Then wait in a room solely desi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer - Infrastructure

    Senior Software Engineer - Infrastructure

    Epirus • Brooklyn, NY, United States
    serp_jobs.job_card.permanent
    Senior Software Engineer - Infrastructure.Epirus is a high-growth technology company dedicated to overcoming the asymmetric challenges inherent to the future of national security.Epirus' flagship p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer - Infrastructure Los Angeles, California, United States

    Senior Software Engineer - Infrastructure Los Angeles, California, United States

    StubHub • New York, NY, United States
    serp_jobs.job_card.full_time
    Senior Software Engineer - Infrastructure.StubHub is on a mission to redefine the live event experience on a global scale. Whether someone is looking to attend their first event or their hundredth, ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Senior Software Engineer – Cloud Data Platform

    Senior Software Engineer – Cloud Data Platform

    Disneyland Hong Kong • New York, NY, United States
    serp_jobs.job_card.full_time
    A global entertainment company seeks a Senior Software Engineer to drive data platform innovation.The role involves developing critical tools for engineering teams, ensuring operational excellence,...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Data

    Senior Software Engineer, Data

    Alchemy • New York, NY, United States
    serp_jobs.job_card.full_time
    Our mission is to bring web3 to a billion people, by providing builders with the tools they need to build exceptional onchain products. Alchemy is the only complete developer platform that offers th...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Senior Software Engineer - Data Marketplace ExperiencesNew York

    Lead Senior Software Engineer - Data Marketplace ExperiencesNew York

    The Trade Desk • New York, NY, United States
    serp_jobs.job_card.full_time
    The Trade Desk is subject to Executive Order 11246, which requires government contractors to ensure nondiscrimination and take affirmative action in employment to employ and advance qualified indiv...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer, Infrastructure

    Senior Software Engineer, Infrastructure

    Current • New York, NY, United States
    serp_jobs.job_card.full_time
    SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE.Current is a leading consumer fintech platform transforming financial access for everyday Americans with over 5 million members. We provide access to financi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted