Talent.com
Data Collection Engineer
Data Collection EngineerThe Wire Digital Inc • New York, New York, United States, 10001
serp_jobs.error_messages.no_longer_accepting
Data Collection Engineer

Data Collection Engineer

The Wire Digital Inc • New York, New York, United States, 10001
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Data Collection Engineer

Your Role : Data Collection Engineer

As a Data Collection Engineer, you'll play a critical role in acquiring and structuring high-value external data that powers our core products. Your work will fuel our knowledge graph of millions of entities and directly support our mission to deliver transparency and insight into complex global networks.

Youll work closely with engineering, research, and product teams to identify new data sources, develop reliable pipelines to gather, ingest, and structure that data, and continuously improve our ability to scale and adapt. You'll have ownership over how information flows into our platform from design and architecture to reliability and performance and help shape the systems that underpin our next generation of features and products.

What you'll do

  • Design and implement systems to collect, extract, and normalize external data from a variety of sources.
  • Collaborate with researchers and analysts to identify new sources of valuable company data and define integration strategies.
  • Build robust, scalable pipelines that ingest structured and semi-structured data into our database.
  • Ensure high levels of accuracy, coverage, and freshness across incoming data streams.
  • Contribute to the evolution of our data platform and internal tooling.
  • Improve system reliability, observability, and performance over time.

Who you are

  • 3+ years of experience as a backend or full-stack software engineer, ideally working with data ingestion or ETL systems.
  • Intimate knowledge of how to crawl the internet at scale.
  • Strong programming skills, especially in Python.
  • Experience working with structured and unstructured data from diverse external systems.
  • Comfortable debugging complex issues involving networking, content rendering, or inconsistent source data.
  • Proficient with SQL and relational databases.
  • A clear communicator who collaborates effectively with both technical and non-technical teammates.
  • Passionate about turning raw data into meaningful insight, and eager to work on technically nuanced challenges.
  • Ideally you'll have

  • Familiarity with headless browser automation or techniques for collecting data from dynamic content sources.
  • Expertise in the architure, technologies, and tools that run the modern internet such as DNS, networking, CDNs, WAFs, proxies and reverse proxies.
  • Experience with event-driven architecture.
  • Eagerness to incorporate new technologies and validate their usefulness using structured experiments and thorough testing.
  • Experience building health monitoring and observability tools for consumption by automated tools, engineers, and non-technical stakeholders.
  • PI51167d4f4054-30511-37995761

    serp_jobs.job_alerts.create_a_job

    Data Engineer • New York, New York, United States, 10001

    Job_description.internal_linking.related_jobs
    Software Engineer III- Data

    Software Engineer III- Data

    J.P. Morgan • New York, New York, US
    serp_jobs.job_card.full_time
    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Software Engineer III at JPMorgan Chase within the Wholesale Credit Risk ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Senior Data Engineer

    Senior Data Engineer

    January • New York, New York, United States
    serp_jobs.job_card.full_time +1
    At January, we're fixing what's broken in credit.Our data-driven platform rebuilds trust, delivers results, and helps millions move toward brighter financial futures while bringing humanity to cons...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Open Roles • New York, New York, United States
    serp_jobs.job_card.full_time
    Trillium is a leading proprietary trading firm active in US Equities, US Options, Canadian Equities, and OTC Equities.With trading technology built, tested, and optimized in-house, our engineers an...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    JPMorganChase • Jersey, New Jersey, USA
    serp_jobs.job_card.full_time
    Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team.As a Data Engineer III at JPMorganChase you. You are responsible for developing testing and main...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    Match Group • New York, New York, United States
    serp_jobs.job_card.full_time
    Hinge is the dating app designed to be deleted.In today's digital world, finding genuine relationships is tougher than ever. At Hinge, we’re on a mission to inspire intimate connection to create a l...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Iex Group • New York, NY, United States
    serp_jobs.job_card.full_time
    Founded in 2012, IEX launched a new kind of securities exchange in 2016 that combines a transparent business model and unique architecture designed to protect investors. Today, IEX applies its propr...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Credit and Collections Analyst

    Credit and Collections Analyst

    Vaco by Highspring • Mahwah, NJ, US
    serp_jobs.job_card.full_time +1
    The responsibility of the Credit and Collection Analyst is to maximize collections while minimizing.Monitor the credit risk of each customer so as to. The representative will also service customers ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer Clips / ML Data

    Data Engineer Clips / ML Data

    Medal • New York, New York, United States
    serp_jobs.job_card.full_time
    At Medal, we’re redefining how people capture and share gameplay experiences.Every day, our platform ingests tens of thousands of hours of gameplay video—raw, unfiltered, and packed with insights.W...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Customer Data Engineer

    Customer Data Engineer

    Optimove • New York, New York, United States
    serp_jobs.job_card.full_time
    Optimove is a global marketing tech company, recognized as a Leader by Forrester and a Challenger by Gartner.We work with some of the world's most exciting brands, such as Sephora, Staples, and Ent...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer, Platform

    Data Engineer, Platform

    Basis Research Institute • New York, NY, United States
    serp_jobs.job_card.full_time
    AI research organization with two mutually reinforcing goals.This means to establish the mathematical principles of what it means to reason, to learn, to make decisions, to understand, and to expla...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Govx • New York, New York, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modern...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Enablement Engineer

    Data Enablement Engineer

    Betterment • New York, NY, United States
    serp_jobs.job_card.full_time
    Betterment is a leading, technology-driven financial services company that offers investing and retirement solutions for retail investors and investment advisors as well as financial wellness solut...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    10a Labs • New York, New York, United States
    serp_jobs.job_card.full_time
    Labs is an applied research and AI security company trusted by AI unicorns, Fortune 10 companies, and U.We combine proprietary technology, deep expertise, and multilingual threat intelligence to de...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Fanduel • New York, New York, United States
    serp_jobs.job_card.full_time
    Our roster has an opening with your name on it.At FanDuel, our data platform underpins critical business operations that need to run with maximum efficiency and scalability.As our business continue...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    GCP Data Engineer

    GCP Data Engineer

    Zone It Solutions • New York, New York, United States
    serp_jobs.job_card.full_time
    We are seeking a talented GCP Data Engineer based in California City.You will be responsible for designing, building, and maintaining robust data pipelines and data solutions on the Google Cloud Pl...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    BHFT • New York City, New York, USA
    serp_jobs.job_card.full_time
    Data Engineering team is responsible for designing building and maintaining the Data Lake infrastructure including ingestion pipelines storage systems and internal tooling for reliable scalable acc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Rain • New York, New York, United States
    serp_jobs.job_card.full_time
    At Rain, we’re rebuilding the global financial pipes money flows through.Our infrastructure makes stablecoins usable in the real world by powering credit card transactions, cross-border payments, B...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer - Hadoop

    Data Engineer - Hadoop

    GTN Technical Staffing • New York, New York, United States
    serp_jobs.job_card.permanent
    Data Engineer – Hadoop Administrator.Location : Chicago, IL / New York, NY / Phoenix, AZ (Hybrid).Data Science R&D compute cluster. ML Ops organization, providing hands-on operational support for the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted