Talent.com
Hadoop Developer

Hadoop Developer

American Recruiting & Consulting GroupJacksonville, FL, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.permanent
job_description.job_card.job_description

Job Description

Job Description

Senior Hadoop Developer - Hybrid

ARC Group has an immediate opportunity for a Senior Hadoop Developer! This position is a Hybrid role in Jacksonville, FL. This is starting out as a contract position running through December 2025 with strong potential to extend longer or convert to FTE. This is a fantastic opportunity to join a well-respected organization offering tremendous career growth potential.

At ARC Group, we are committed to fostering a diverse and inclusive workplace where everyone feels valued and respected. We believe that diverse perspectives lead to better innovation and problem-solving. As an organization, we embrace diversity in all its forms and encourage individuals from underrepresented groups to apply.

Reference # 18839-1

Candidates must currently have PERMANENT US work authorization.   Sorry, but we are not considering any candidates from outside companies for this position (no C2C, 3rd party / brokering).

  • Hybrid / onsite (Jacksonville)-2 days per week

Project Scope :

Candidates will lead the development and implementation of the next-generation Ingestion Framework (Aka Ingestion Framework Modernization) that writes data into Iceberg. These resources will lead the design and development of the new Ingestion Framework using Apache Spark, ensuring it meets the requirements of scalability, performance, and reliability.

A Sr Hadoop developer is responsible for the design, development and operations of systems that store and manage large amounts of data. Most Sr Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science.

Must Have as Prior Experience :

  • Design and Develop Ingestion Patterns : Lead the design and development of a modernized ingestion patterns using Spark as the base orchestration engine, ensuring scalability, reliability, and performance.
  • Create Jars for File Parsing : Develop and maintain Jars for parsing files of various formats (e.g., CSV, JSON, Avro, Parquet) and writing to Iceberg, ensuring data quality and integrity.
  • Integrate with Recon Framework : Integrate the ingestion patterns with the Recon Framework through Jars, ensuring seamless data reconciliation and validation.
  • Integrate with CDC Tool : Integrate the ingestion patterns with the CDC (Change Data Capture) Tool, enabling real-time data ingestion and processing.
  • Collaborate with Cross-Functional Teams : Work closely with data engineers, data scientists, and other stakeholders to ensure the ingestion patterns and configurations meets business requirements and is aligned with overall data architecture.
  • Troubleshoot and Optimize : Troubleshoot issues, optimize performance, and ensure the ingestion patterns of different types of files is running efficiently and effectively.
  • Code Review and Quality Assurance : Perform code reviews, ensure adherence to coding standards, and maintain high-quality code.

    • Job Requirements :

  • Experience and understanding with unit testing, release procedures, coding design and documentation protocol as well as change management procedures
  • Proficiency using versioning tools
  • Thorough knowledge of Information Technology fields and computer systems
  • Demonstrated organizational, analytical and interpersonal skills
  • Flexible team player
  • Ability to manage tasks independently and take ownership of responsibilities
  • Ability to learn from mistakes and apply constructive feedback to improve performance
  • Must demonstrate initiative and effective independent decision-making skills
  • Ability to communicate technical information clearly and articulately
  • Ability to adapt to a rapidly changing environment
  • In-depth understanding of the systems development life cycle
  • Proficiency programming in more than one object-oriented programming language
  • Proficiency using standard desktop applications such as MS Suite and flowcharting tools such as Visio
  • Proficiency using debugging tools
  • High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy

    • Must Have Skills :

  • Technical Skills :

    • 5+ years of experience in Hadoop ecosystem (HDFS, Spark, Hive, etc.)

  • Strong expertise in Spark (Scala / Java) and experience with Spark-based data processing frameworks
  • Experience with Iceberg and data warehousing concepts
  • Proficiency in Java and / or Scala programming languages
  • Experience with JAR (Java Archive) development and deployment
  • Familiarity with CDC tools (Kafka, etc.) and Recon Frameworks
  • Proficiency in building Jars for parsing different type of files
  • Ingestion Patterns Experience : Proven experience in designing and developing ingestion patterns, preferably with Spark as the base orchestration engine.
  • Data Processing and Integration : Experience with data processing, integration, and reconciliation, including data quality and validation.
  • Collaboration and Communication : Excellent collaboration and communication skills, with the ability to work with cross-functional teams and stakeholders.
  • Problem-Solving and Troubleshooting : Strong problem-solving and troubleshooting skills, with the ability to analyze complex issues and develop effective solutions.

    • Specific Tools / Languages Required :

  • HADOOP
  • Spark
  • Scala
  • Python

    • Required Work Experience :

  • 5+ years related work experience, Professional experience with technical design and coding in the IT industry

    • Required Education :

  • Related Bachelor's degree or related work experience

    • Would you like to know more about our new opportunity?  For immediate consideration, please send your resume directly to Suresh Gaddala at  suresh@arcgonline.com  or apply online while viewing all of our open positions at  www.arcgonline.com.

    ARC Group is a Forbes-ranked a top 20 recruiting and executive search firm working with clients nationwide to recruit the highest quality technical resources. We have achieved this by understanding both our candidate's and client's needs and goals and serving both with integrity and a shared desire to succeed.

    At ARC Group, we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.

    Position is offered with no fee to candidate.

    Powered by JazzHR

    hiJqnZzShV

    serp_jobs.job_alerts.create_a_job

    Developer • Jacksonville, FL, US