Talent.com
Big Data Developer
Big Data DeveloperPSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, United States
Big Data Developer

Big Data Developer

PSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.permanent
job_description.job_card.job_description

The Big Data Developer will play a critical role on the Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and innovation. The ideal candidate has hands-on experience building enterprise-grade data pipelines, working with distributed systems, and optimizing data processing workflows.

This is a long-term project (12+ months) with high visibility, cutting-edge tools, and opportunities to influence technical direction.

  • U.S. CITIZENSHIP OR PERMANENT RESIDENCY REQUIRED. VISA OR EAD STATUS NOT ACCEPTABLE FOR THIS POSITION. NO EXCEPTIONS

What You’ll Do

  • Data Pipeline Design & Development
  • Design, build, and deploy scalable data pipelines for ingesting, processing, transforming, and storing high-volume datasets.
  • Implement streaming and batch-processing solutions using Hadoop, Spark, and cloud-based tools.
  • Data Architecture & Engineering
  • Develop and maintain data architecture and data flow models.
  • Ensure data reliability, accuracy, and integrity across all environments.
  • Support data warehousing strategies and best practices.
  • Data Quality, Security & Compliance
  • Implement automated data validation, error handling, and monitoring.
  • Ensure compliance with internal security controls and regulatory standards.
  • Partner with governance teams to enforce data quality and security guidelines.
  • Cross-Functional Collaboration
  • Work closely with data scientists, analysts, product teams, and application developers.
  • Translate business requirements into robust technical solutions.
  • Participate in Agile ceremonies and contribute to technical design discussions.
  • Performance Optimization
  • Tune Spark applications, Hadoop jobs, and distributed data systems for performance and cost efficiency.
  • Troubleshoot bottlenecks and implement improvements to system performance.
  • Technical Leadership
  • Provide mentorship to junior developers and contribute to coding standards, best practices, and technical documentation.

    • Required Skills & Qualifications

  • 4+ years of Big Data Development experience in Hadoop ecosystems
  • 2+ years of hands-on development with Apache Spark
  • Proficiency in Java, Scala, or Python
  • Strong understanding of distributed systems , ETL , data warehousing , and data modeling concepts
  • Experience with large-scale datasets , performance tuning, and troubleshooting
  • Strong problem-solving, communication, and collaboration skills
  • Bachelor’s degree in Computer Science, Engineering, or related discipline

    • Preferred Skills

  • Experience working with AWS cloud services (EMR, S3, Lambda, Glue, etc.)
  • Experience with Spark 3.x or 4.x
  • Exposure to Kubernetes, Airflow, or similar orchestration tools
  • Familiarity with CI / CD and DevOps automation for data engineering

    • Why This Opportunity Stands Out

  • Long-term project stability (12+ months, likely extension)
  • Ability to work on high-impact scientific and research-driven datasets
  • Hands-on cloud modernization (AWS) and next-generation big data tooling
  • Collaborative and innovative engineering culture
    • serp_jobs.job_alerts.create_a_job

    Big Data Developer • Columbus, Ohio Metropolitan Area, United States

    Job_description.internal_linking.related_jobs
    Senior Cloud Data Developer - API Focus

    Senior Cloud Data Developer - API Focus

    quantum-health • Dublin, OH, United States
    serp_jobs.job_card.permanent
    This position may work remotely anywhere in the United States of America.Founded in 1999 and headquartered in Central Ohio, we’re a privately-owned, independent healthcare navigation organization.W...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer (Columbus)

    Data Engineer (Columbus)

    Agility Partners • Columbus, Ohio Metropolitan Area, US
    serp_jobs.job_card.part_time
    The ideal candidate will have hands-on experience with.Design, implement, and optimize.Partner with cross-functional teams to define data requirements and deliver business-ready solutions.Strong, p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Datastage Developer - Columbus, OH - ONSITE FROM DAY 1

    Datastage Developer - Columbus, OH - ONSITE FROM DAY 1

    Qualis1 Inc • OH, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Hi serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Data Engineer

    Data Engineer

    Agility Partners • Columbus, Ohio Metropolitan Area, United States
    serp_jobs.job_card.full_time
    The ideal candidate will have hands-on experience with.Design, implement, and optimize.Partner with cross-functional teams to define data requirements and deliver business-ready solutions.Strong, p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    CDL-A Flatbed Truck Driver - $0.40 to $0.48 per mile in Orient, OH

    CDL-A Flatbed Truck Driver - $0.40 to $0.48 per mile in Orient, OH

    AllTruckJobs • Orient, OH, US
    serp_jobs.job_card.full_time
    CALL TO SPEAK WITH A SEATING SPECIALIST TODAY! .Western Express has immediate openings for entry level company truck drivers and driver trainers. With our newly increased pay package, you'll earn on...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel Cytotech / Cytogenetics - $2,366 to $2,623 per week in Lewes, DE

    Travel Cytotech / Cytogenetics - $2,366 to $2,623 per week in Lewes, DE

    LRS Healthcare • Delaware, US
    serp_jobs.job_card.full_time
    Ready to start your next travel adventure? LRS Healthcare offers a full benefits package, 24 / 7 support, and a responsive, traveler-first culture. What are you waiting for? Apply today!.Valid license...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Travel Cytotech / Cytogenetics - $2,126 to $2,444 per week in Lewes, DE

    Travel Cytotech / Cytogenetics - $2,126 to $2,444 per week in Lewes, DE

    Fusion Medical Staffing • Delaware, US
    serp_jobs.job_card.full_time
    Fusion Medical Staffing is seeking a skilled Cytotechnologist for a 13 week travel assignment in Lewes, DE.As a member of our team, you'll have the opportunity to make a positive impact on the live...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Big Data Developer

    Big Data Developer

    TRIMAH TECHNOLOGIES LLC • Columbus, OH, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    MessageBody"> About the Role The Big Data Developer will play a critical role on the Big Data engineering team, designing and implementi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Big Data Developer (Columbus)

    Big Data Developer (Columbus)

    PSI (Proteam Solutions) • Columbus, Ohio Metropolitan Area, United States
    serp_jobs.job_card.permanent
    Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and innovation. The ideal candidate has hands-on experience building enterpri...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Career Mentors, LLC • Columbus, OH, US
    serp_jobs.job_card.full_time
    Columbus, OH (Onsite – 5 Days a Week).W2 Only (Local Candidates Preferred).PAM (Privileged Access Management).Privileged Access Management (PAM) group in Columbus, OH. This role requires a highly mo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Travel Vascular Tech in Dover, DE

    Travel Vascular Tech in Dover, DE

    AlliedTravelCareers • Delaware, US
    serp_jobs.job_card.full_time +1
    AlliedTravelCareers is working with Infojini Healthcare to find a qualified Vascular Tech in Dover, Delaware, 19901!.CV Tech travel Cardiology needed in Dover, Delaware. Self Assessment (Skills Chec...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Work From Home -Remote AI Content Proofreader

    Work From Home -Remote AI Content Proofreader

    Outlier • Remote, OH, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Account Executive, Data Breach

    Account Executive, Data Breach

    Relativity • Columbus, OH, United States
    serp_jobs.job_card.full_time
    The Account Executive, Data Breach Response role is an SME role focused on bringing Relativity's AI product, Data Breach Response to new and existing customers at the largest companies in the world...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Remote AI Content Proofreader

    Remote AI Content Proofreader

    Outlier • Remote, OH, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Diesel Technician - 4 Day Work Week

    Diesel Technician - 4 Day Work Week

    Crete Carrier Corporation • Circleville, OH, US
    serp_jobs.job_card.full_time
    Crete Carrier is actively hiring Diesel Technicians in Columbus, OH.Come join a team that keeps America moving - and rewards the people who make it happen. Why Technicians Choose Crete Carrier : .We k...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Enterprise Data & AI Architect

    Enterprise Data & AI Architect

    Encova Insurance • Columbus, OH, United States
    serp_jobs.job_card.full_time
    The salary range for this job posting is $108,812.The above represents the full salary range for this job requisition.Ultimately, in determining your pay and job title, we'll consider your location...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    CDL-A Flatbed Truck Driver - $0.40 to $0.48 per mile in Commercial Point, OH

    CDL-A Flatbed Truck Driver - $0.40 to $0.48 per mile in Commercial Point, OH

    AllTruckJobs • Commercial Point, OH, US
    serp_jobs.job_card.full_time
    CALL TO SPEAK WITH A SEATING SPECIALIST TODAY! .Western Express has immediate openings for entry level company truck drivers and driver trainers. With our newly increased pay package, you'll earn on...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    W2 Contract Req : Big Data / Spark Developer (Hybrid / Columbus, OH) (Columbus)

    W2 Contract Req : Big Data / Spark Developer (Hybrid / Columbus, OH) (Columbus)

    TRIMAH TECHNOLOGIES LLC • Columbus, Ohio Metropolitan Area, United States
    serp_jobs.job_card.full_time
    Job Title : Big Data / Spark Developer.Location : Columbus, OH (Hybrid).Big Data engineering team, designing and implementing large-scale data processing systems that power scientific research and inno...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted