Hadoop Data Lake Automation EngineerCloudious LLC • Charlotte, NC, United States
serp_jobs.error_messages.no_longer_accepting
Hadoop Data Lake Automation Engineer
Cloudious LLC • Charlotte, NC, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
- serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description3 5 years of hands-on experience in Hadoop ecosystem (HDFS, Hive, Spark, Sqoop, Oozie, etc.). Strong experience in automating data lake workflows and ETL processes. Proficiency in scripting languages such as Python, Shell, or Scala. Experience with scheduling and orchestration tools (e.g., Apache Airflow, Control-M, AutoSys). Solid understanding of data modelling, data quality, and performance optimization. Familiarity with cloud platforms (AWS, Azure, GCP) and big data services. Excellent problem-solving and communication skills. Experience with Apache NiFi or similar data flow tools. Exposure to CI / CD pipelines and DevOps practices. Knowledge of data cataloguing and lineage tools.
Job Summary :
We are looking for a skilled and motivated Hadoop Data Lake Automation Engineer with 4 5 years of experience in automating data workflows and processes within Hadoop-based data lake environments. The ideal candidate will be responsible for building scalable automation solutions, optimizing data pipelines, and ensuring efficient data movement and transformation across platforms.
Key Responsibilities :
- Design and implement automation solutions for data ingestion, transformation, and processing in Hadoop data lake environments.
- Develop and maintain scalable data pipelines using tools such as Apache NiFi, Spark, Hive, and Sqoop.
- Collaborate with data engineers, analysts, and business stakeholders to understand data requirements and deliver automation solutions.
- Monitor and troubleshoot data workflows, ensuring reliability and performance.
- Implement best practices for data governance, security, and metadata management.
- Maintain documentation for data flows, automation scripts, and operational procedures.
- Support production environments and participate in on-call rotations as needed.
Required Skills & Qualifications :
Preferred Qualifications :
serp_jobs.job_alerts.create_a_job
Automation Engineer • Charlotte, NC, United States
Job_description.internal_linking.related_jobs
Experience with multiple large-scale Enterprise Hadoop or Big Data, Data Bricks, Cloudera, HD Insights, or other environments focused on operations, design, capacity planning, cluster setup, securi...serp_jobs.internal_linking.show_more
This position supports the Project Management Office in advancing how projects are planned, tracked, and analyzed through data integration, automation, and AI.
This role contributes to building the ...serp_jobs.internal_linking.show_more
IT experience with more that 4+ years of experience in Hadoop / Big Data technologies (HDFS, SQOOP, Hive, Pig, Spark, Impala, Oozie etc.
Strong Hands-on experience in working with.Cloudera Data Hadoop...serp_jobs.internal_linking.show_more
LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by ha...serp_jobs.internal_linking.show_more
Previous experience as a Hadoop developer or big data engineer.Advanced knowledge of the Hadoop ecosystem and its components.
In-depth knowledge of Hive, HBase, and Pig.Familiarity with MapReduce an...serp_jobs.internal_linking.show_more
Senior Analyst, Capacity Planning.This role plays a key part in driving operational efficiency and workforce scalability in large, regulated environments.
Reporting to the Senior Manager, Capacity P...serp_jobs.internal_linking.show_more
US Citizen or those with authorized work visa to work for any employer within USA without any visa sponsorship are eligible to apply.
Minimum 3-5plus years of hands-on technical experience implement...serp_jobs.internal_linking.show_more
A client of Innova Solutions is immediately hiring for.Hybrid : 3 Days onsite and 2 days remote.The ideal candidate will have : ETL, Data Engineering, Hadoop, Ecosystem, Hive and Spark.Develop, suppo...serp_jobs.internal_linking.show_more Must have : Selenium & Python Job Description We are ...serp_jobs.internal_linking.show_more 
Opportunity : Ot Deployment Lead.The OT Deployment Lead ensures successful deployment of OT products across terminals, driving project execution, stakeholder alignment, and compliance.This role blen...serp_jobs.internal_linking.show_more
Dexian is seeking a Hadoop Developer for an opportunity with a client located in Charlotte, NC.Develop, support Enterprise Credit Risk ETL platform.
Develop unit / integration / regression / perform...serp_jobs.internal_linking.show_more
AYR Global IT Solutions is a national staffing firm focused on cloud, cyber security, web application services, ERP, and BI implementations by providing proven and experienced consultants to our cl...serp_jobs.internal_linking.show_more
Immediate contract opportunity for Lead / Principal Data Engineer / Architect.Trigyn has an immediate opening for Lead / Principal Data Engineer in Charlotte, NC (Remote).
The particulars of the opportun...serp_jobs.internal_linking.show_more
Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today's most important industries.
Our growth is driven by delivering re...serp_jobs.internal_linking.show_more
Hadoop SRE / Hadoop Administrator.Profile Types We Are Targeting.Were looking for candidates who have grown through system engineering, big data administration, or platform engineering roles and ha...serp_jobs.internal_linking.show_more
Hadoop Developer Location : Charlotte, NC & Chicago, IL (Hybrid) Contract : 12+ Months Contract Job Description : ...serp_jobs.internal_linking.show_more
Hadoop Functional / Automation Test Lead || Charlotte, NC / Plano, TX (Hybrid) || Fulltime.At least 5+ year of experience with Back-end systems / ETL_ Automation / Hadoop Testing / Kafka Kstream.Strong exp...serp_jobs.internal_linking.show_more
Our client, a leading organization in the financial services industry, is seeking a Production Support / Hadoop Engineer (Charlotte) to join their dynamic team.
As a Production Support / Hadoop Engineer...serp_jobs.internal_linking.show_more
Hadoop Data Engineer
Syntricate Technologies • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Data & Automation Analyst
EnergySolutions • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Hadoop Developer (Cloudera, Terraform) - (Fulltime)
The Dignify Solutions LLC • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
QA Automation Engineer (Charlotte)
LTIMindtree • Charlotte, NC, US
serp_jobs.job_card.part_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Hadoop developer
SARIAN Co • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Analyst, Capacity Planning (Remote)
MAXIMUS • Charlotte, NC, United States
serp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
Hadoop Administrator
Sterling 5 • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
ETL Data Engineer
Innova Solutions • Charlotte, NC,North Carolina,United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
serp_jobs.last_updated.last_updated_30
QA Automation Engineer
Cloudious LLC • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
serp_jobs.last_updated.last_updated_variable_days
Deployment Lead Automation
Charlotte Staffing • Charlotte, NC, US
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Hadoop Developer (Charlotte)
Dexian • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Automation Analyst
AYR Global IT Solutions Inc. • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Lead / Principal Data Engineer / Architect (HDFS, S3, Spark, Kafka)
Trigyn Technologies Inc • Charlotte, NC, US
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Manager, Cloud Development & Automation
KPMG • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Hadoop Administrator (Charlotte)
Matlen Silver • Charlotte, NC, US
serp_jobs.job_card.part_time
serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
Hadoop Developer - Charlotte, NC & Chicago, IL (Hybrid)
Lorven technologies • Charlotte, NC, United States
serp_jobs.job_card.temporary
serp_jobs.filters_job_card.quick_apply
serp_jobs.last_updated.last_updated_variable_days
Hadoop Functional / Automation Test Lead
Diverse Lynx • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Production Support / Hadoop Engineer (Charlotte)
Experis • Charlotte, NC, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted