Talent.com
Big Data Developer
Big Data DeveloperPSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, United States
Big Data Developer

Big Data Developer

PSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.permanent
job_description.job_card.job_description

The Big Data Developer will play a critical role on the Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and innovation. The ideal candidate has hands-on experience building enterprise-grade data pipelines, working with distributed systems, and optimizing data processing workflows.

This is a long-term project (12+ months) with high visibility, cutting-edge tools, and opportunities to influence technical direction.

  • U.S. CITIZENSHIP OR PERMANENT RESIDENCY REQUIRED. VISA OR EAD STATUS NOT ACCEPTABLE FOR THIS POSITION. NO EXCEPTIONS

What You’ll Do

  • Data Pipeline Design & Development
  • Design, build, and deploy scalable data pipelines for ingesting, processing, transforming, and storing high-volume datasets.
  • Implement streaming and batch-processing solutions using Hadoop, Spark, and cloud-based tools.
  • Data Architecture & Engineering
  • Develop and maintain data architecture and data flow models.
  • Ensure data reliability, accuracy, and integrity across all environments.
  • Support data warehousing strategies and best practices.
  • Data Quality, Security & Compliance
  • Implement automated data validation, error handling, and monitoring.
  • Ensure compliance with internal security controls and regulatory standards.
  • Partner with governance teams to enforce data quality and security guidelines.
  • Cross-Functional Collaboration
  • Work closely with data scientists, analysts, product teams, and application developers.
  • Translate business requirements into robust technical solutions.
  • Participate in Agile ceremonies and contribute to technical design discussions.
  • Performance Optimization
  • Tune Spark applications, Hadoop jobs, and distributed data systems for performance and cost efficiency.
  • Troubleshoot bottlenecks and implement improvements to system performance.
  • Technical Leadership
  • Provide mentorship to junior developers and contribute to coding standards, best practices, and technical documentation.

    • Required Skills & Qualifications

  • 4+ years of Big Data Development experience in Hadoop ecosystems
  • 2+ years of hands-on development with Apache Spark
  • Proficiency in Java, Scala, or Python
  • Strong understanding of distributed systems , ETL , data warehousing , and data modeling concepts
  • Experience with large-scale datasets , performance tuning, and troubleshooting
  • Strong problem-solving, communication, and collaboration skills
  • Bachelor’s degree in Computer Science, Engineering, or related discipline

    • Preferred Skills

  • Experience working with AWS cloud services (EMR, S3, Lambda, Glue, etc.)
  • Experience with Spark 3.x or 4.x
  • Exposure to Kubernetes, Airflow, or similar orchestration tools
  • Familiarity with CI / CD and DevOps automation for data engineering

    • Why This Opportunity Stands Out

  • Long-term project stability (12+ months, likely extension)
  • Ability to work on high-impact scientific and research-driven datasets
  • Hands-on cloud modernization (AWS) and next-generation big data tooling
  • Collaborative and innovative engineering culture
    • serp_jobs.job_alerts.create_a_job

    Big Data Developer • Columbus, Ohio Metropolitan Area, United States

    Job_description.internal_linking.related_jobs
    Senior Cloud Data Developer - API Focus

    Senior Cloud Data Developer - API Focus

    quantum-health • Dublin, OH, United States
    serp_jobs.job_card.permanent
    This position may work remotely anywhere in the United States of America.Founded in 1999 and headquartered in Central Ohio, we’re a privately-owned, independent healthcare navigation organization.W...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer (Columbus)

    Data Engineer (Columbus)

    Agility Partners • Columbus, Ohio Metropolitan Area, US
    serp_jobs.job_card.part_time
    The ideal candidate will have hands-on experience with.Design, implement, and optimize.Partner with cross-functional teams to define data requirements and deliver business-ready solutions.Strong, p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Datastage Developer - Columbus, OH - ONSITE FROM DAY 1

    Datastage Developer - Columbus, OH - ONSITE FROM DAY 1

    Qualis1 Inc • OH, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Hi serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Travel Nurse RN - Telemetry - $2,336 per week in Dover, DE

    Travel Nurse RN - Telemetry - $2,336 per week in Dover, DE

    TravelNurseSource • Delaware, US
    serp_jobs.job_card.full_time
    TravelNurseSource is working with FlexCare to find a qualified Telemetry RN in Dover, Delaware, 19901!.FlexCare is a nationwide leader in the staffing of travel nurses and clinicians.With access to...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Novalink Solutions • Columbus, Ohio, United States
    serp_jobs.job_card.full_time
    The candidate must have senior data engineer experience in the following : .Experience collecting and managing Public Health data from public sources, including US Census, Center for Disease Control ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer (NO OPT / CPT / H1B)

    Data Engineer (NO OPT / CPT / H1B)

    Donato Technologies • Columbus, Ohio, United States
    serp_jobs.job_card.full_time
    Greetings from Donato Technologies Inc.We have an immediate opening with my client.If you are looking for a new project, please send me a copy of your updated resume. Columbus OH and Jersey City, NJ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Databricks Developer

    Databricks Developer

    Diverse Lynx • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Job Title : Databricks Developer.Location : Columbus OH (Onsite).Must Have Functional Skills 5 years of experience in Databricks. At least 2-3 years of experience in Working with Informatica.Good unde...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Big Data Developer (Columbus)

    Big Data Developer (Columbus)

    PSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, US
    serp_jobs.job_card.part_time +1
    Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and innovation. The ideal candidate has hands-on experience building enterpri...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Big Data Developer

    Big Data Developer

    TRIMAH TECHNOLOGIES LLC • Columbus, OH, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    MessageBody"> About the Role The Big Data Developer will play a critical role on the Big Data engineering team, designing and implementi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Career Mentors, LLC • Columbus, OH, US
    serp_jobs.job_card.full_time
    Columbus, OH (Onsite – 5 Days a Week).W2 Only (Local Candidates Preferred).PAM (Privileged Access Management).Privileged Access Management (PAM) group in Columbus, OH. This role requires a highly mo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Senior Software Engineer - Big Data

    Senior Software Engineer - Big Data

    Oracle • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Oracle's Cloud Infrastructure team is building new Infrastructure-as-a-Service technologies that operate at high scale in a broadly distributed multi-tenant cloud environment.Our customers run thei...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    DataStage Developer / Lead

    DataStage Developer / Lead

    United Software Group • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Heitmeyer Consulting is currently seeking a DataStage Developer for a contract-to-hire opportunity with one of our financial services clients in Columbus, OH. The candidate will design, develop, int...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    DataStage Developer

    DataStage Developer

    InstantServe LLC • Columbus, OH, United States
    serp_jobs.job_card.temporary
    Job Title : DataStage Developer.Duration : 3-month contract to hire.The client is currently seeking a DataStage Developer for a contract-to-hire opportunity with one of our financial services clients...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    DataStage ETL Developer - Local to Columbus, Ohio

    DataStage ETL Developer - Local to Columbus, Ohio

    CGI • Columbus, OH, United States
    serp_jobs.job_card.full_time
    DataStage ETL Developer - Local to Columbus, Ohio.Category : Software Development / Engineering.Main location : United States, Ohio, Columbus. Are you passionate about transforming raw data into action...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    W2 Contract Req : Big Data / Spark Developer (Hybrid / Columbus, OH) (Columbus)

    W2 Contract Req : Big Data / Spark Developer (Hybrid / Columbus, OH) (Columbus)

    TRIMAH TECHNOLOGIES LLC • Columbus, Ohio Metropolitan Area, United States
    serp_jobs.job_card.full_time
    Job Title : Big Data / Spark Developer.Location : Columbus, OH (Hybrid).Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and inno...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    DataStage Developer

    DataStage Developer

    My3Tech Inc • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Job Title : DataStage Developer.Job Location : Columbus, OH (Hybrid).Contract Length : 3-Months (Contract to Hire).Lead the design and development of ETL processes using IBM DataStage.Manage and mento...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Datastage Developer

    Datastage Developer

    Artech • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Required Skills & Qualifications.Applicants must be able to work directly for Artech on W2.Proficiency in IBM InfoSphere DataStage. Basic knowledge of Unix / Linux commands.Preferred Skills & Qualific...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer(only W2)

    Senior Data Engineer(only W2)

    CBTS • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Java.Proficienc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted