Talent.com
Data Engineer ID43228
Data Engineer ID43228AgileEngine • Houston, TX, us
Data Engineer ID43228

Data Engineer ID43228

AgileEngine • Houston, TX, us
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

Job Description

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

As a Middle Data Engineer , you’ll build and optimize ETL pipelines and cloud data solutions that provide reliable insights for data scientists and analysts. You’ll tackle complex data challenges, collaborate with cross-functional teams, and grow your expertise in Python, Airflow, Spark, and AWS in a dynamic, innovative environment.

WHAT YOU WILL DO

  • Build and support ETL pipelines;
  • Monitor data pipelines, identify bottlenecks, optimize data processing and storage for performance and cost-effectiveness;
  • Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders;
  • Working with Terraform to build AWS infrastructure;
  • Analyze sources and build Cloud Data Warehouse and Data Lake solution.

MUST HAVES

  • You must be authorized to work for ANY employer in the US (e.g., Green card holders, TN visa holders, GC EAD, H4 EAD, U4U with EAD), as we are unable to sponsor or take over employment visa sponsorship at this time;
  • 3+ years of professional experience with Python ;
  • 3+ years of professional experience in a Data Engineering role;
  • Proficiency in programming languages commonly used in data engineering such as Python , SQL , and optionally Scala for working with data processing frameworks like Spark and libs like Pandas;
  • Proficiency in designing, deploying, and managing data pipelines using Apache Airflow for workflow orchestration and scheduling;
  • Ability to design, develop, and optimize ETL processes to move and transform data from various sources into the data warehouse, ensuring data quality, reliability, and efficiency;
  • Knowledge of big data technologies and frameworks such as Apache Spark for processing large volumes of data efficiently;
  • Extensive hands-on experience with various AWS services relevant to data engineering, including but not limited to Amazon MWAA, Amazon S3, Amazon RDS, Amazon EMR, AWS Lambda, AWS Glue, Amazon Redshift, AWS Data Pipeline, Amazon DynamoDB;
  • Deep understanding and practical experience in building and optimizing cloud data warehousing solutions;
  • Ability to monitor data pipelines, identify bottlenecks, and optimize data processing and storage for performance and cost-effectiveness;
  • Excellent communication skills to collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders;
  • Bachelor’s degree in computer science / engineering or other technical field, or equivalent experience;
  • Upper-intermediate English level.
  • NICE TO HAVES

  • Familiarity with the fintech industry, understanding of financial data, regulatory requirements, and business processes specific to the domain;
  • Documentation skills to document data pipelines, architecture designs, and best practices for knowledge sharing and future reference;
  • GCP services relevant to data engineering;
  • Snowflake;
  • OpenSearch, Elasticsearch;
  • Jupyter for analyze data;
  • Bitbucket, Bamboo;
  • Terraform.
  • PERKS AND BENEFITS

  • Professional growth : Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation : We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
  • A selection of exciting projects : Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
  • Flextime : Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
  • serp_jobs.job_alerts.create_a_job

    Data Engineer • Houston, TX, us

    Job_description.internal_linking.related_jobs
    Data Engineer

    Data Engineer

    BCforward • Houston, TX, United States
    serp_jobs.job_card.full_time
    Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship •.Looking for someone with Proficiency in languages Scala or Python, Platform Databr...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer (Middle) ID43228

    Data Engineer (Middle) ID43228

    AgileEngine • Houston, TX, us
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Data Engineer

    Data Engineer

    Spawglass • Houston, Texas, United States
    serp_jobs.job_card.full_time
    As our Data Engineer, you will take ownership of designing, building, and maintaining the data infrastructure that powers business insights and operational reporting. You’ll develop robust data pipe...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer (Houston)

    Data Engineer (Houston)

    BCforward • Houston, TX, US
    serp_jobs.job_card.part_time
    Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship •.Looking for someone with Proficiency in languages Scala or Python, Platform Databr...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer (Houston)

    Senior Data Engineer (Houston)

    Neudesic, an IBM Company • Houston, TX, US
    serp_jobs.job_card.part_time
    About Neudesic, an IBM Company : .Passion for technology drives us, but its innovation that defines us.From design to development and support to management, Neudesic offers decades of experience, pro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer- Houston Based

    Data Engineer- Houston Based

    Cg Infinity • Houston, Texas, United States
    serp_jobs.job_card.full_time
    CG Infinity is a technology consulting firm founded in 1998.We deliver tailored solutions that solve real business challenges—no templates, no shortcuts. Our teams work closely with clients to build...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    The Friedkin Group • Houston, TX, United States
    serp_jobs.job_card.full_time
    All associates are guided by Our Values.Our Values are the unifying foundation of our companies.We strive to ensure that every decision we make and every action we take demonstrates Our Values.We b...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    X4 Technology • Houston, TX, United States
    serp_jobs.job_card.full_time
    This is a fantastic opportunity to join an internationally renowned powerhouse within the supply chain industry.You will have the opportunity to work on a variety of different projects across teams...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Johnson Law Group • Houston, Texas, United States
    serp_jobs.job_card.full_time
    Johnson Law Group is a nationally recognized plaintiffs’ law firm headquartered in Houston, Texas.We have been in business for over 20 years, representing individuals and families in personal injur...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer (Houston)

    Senior Data Engineer (Houston)

    Emergent Professional Resources L.P. (EPR) • Houston, TX, US
    serp_jobs.job_card.part_time
    Our Midstream Oil and Gas client is seeking a skilled.You will work closely with data scientists, analysts, and software engineers to ensure data availability, quality, and reliability across the o...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    SR Data Engineer

    SR Data Engineer

    Alliance Technical Group • Houston, TX, United States
    serp_jobs.job_card.full_time
    Alliance Technical Group is seeking an experienced Senior Data Engineer to design, build, and optimize the databases and data systems that power our business intelligence and analytics platforms.In...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    GCP Data Engineer

    GCP Data Engineer

    Zone It Solutions • Houston, Texas, United States
    serp_jobs.job_card.full_time
    We are seeking a talented GCP Data Engineer based in California City.You will be responsible for designing, building, and maintaining robust data pipelines and data solutions on the Google Cloud Pl...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer (Houston)

    Data Engineer (Houston)

    X4 Technology • Houston, TX, US
    serp_jobs.job_card.part_time
    This is a fantastic opportunity to join an internationally renowned powerhouse within the supply chain industry.You will have the opportunity to work on a variety of different projects across teams...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Neudesic, an IBM Company • Houston, TX, US
    serp_jobs.job_card.full_time
    About Neudesic, an IBM Company : .Passion for technology drives us, but it's innovation that defines usFrom design to development and support to management, Neudesic offers decades of experience, pro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer (Houston)

    Data Engineer (Houston)

    Hedge Fund • Houston, TX, US
    serp_jobs.job_card.full_time +1
    We are looking for a talented and motivated Python Data Engineers.We need help expanding our data assets in support of our analytical capabilities in a full-time role. This role will have the opport...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer Director

    Data Engineer Director

    Whitewater Express Car Wash • Houston, Texas, United States
    serp_jobs.job_card.full_time
    At WhiteWater Express, we are more than just a car wash; we are a company built on respect, communication, and a passion for people. Our dedicated team members are leaders within the company, and we...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    Cognite • Houston, Texas, United States
    serp_jobs.job_card.full_time
    Cognite is gearing up for an exciting year of growth in 2026.As we expand our global footprint and scale our impact across industries, we’re building our team with talented, forward-thinking indivi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Zone It Solutions • Houston, Texas, United States
    serp_jobs.job_card.full_time +1
    We are actively looking for Data Engineer for a permanent position.This exciting opportunity is with a well-established global IT service provider known for its excellence in the industry.Designing...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted