Responsible for implementation and ongoing administration of Hadoop infrastructure.
Responsible for cluster maintenance, troubleshooting, monitoring, and following proper backup & recovery strategies.
Provisioning and managing the life cycle of multiple clusters like EMR & EKS.
Infrastructure monitoring, logging & alerting with Prometheus, Grafana, and Splunk.
Performance tuning of Hadoop clusters and Hadoop workloads, including capacity planning at the application / queue level.
Responsible for memory management, queue allocation, and distribution experience in Hadoop / Cloud era environments.
Should be able to scale clusters in production and have experience with 18 / 5 or 24 / 5 production environments.
Monitor Hadoop cluster connectivity and security, including file system (HDFS) management and monitoring.
Investigate and analyze new technical possibilities, tools, and techniques that reduce complexity, create more efficient and productive delivery processes, or deliver better technical solutions that increase business value.
Involved in fixing issues, performing RCA, and suggesting solutions for infrastructure / service components.
Responsible for meeting Service Level Agreement (SLA) targets and collaboratively ensuring team targets are met.
Ensure all changes to production systems are planned and approved in accordance with the Change Management process.
Collaborate with application teams to install operating system and Hadoop updates, patches, and version upgrades when required.
Maintain central dashboards for all system, data, utilization, and availability metrics.
Ideal Candidate Profile
Experience : 612 years of total experience, with at least 3 years of hands-on work in developing, maintaining, optimizing, and resolving issues in Hadoop clusters supporting business users.
Operating Systems : Experience in Linux / Unix OS services, administration, shell, and awk scripting.
Programming : Strong knowledge of at least one programming language Python, Scala, Java, or R with debugging skills.
Hadoop Ecosystem : Experience in Hadoop components MapReduce, Hive, Pig, Spark, Kafka, HBase, HDFS, H-Catalog, Zookeeper, and Oozie / Airflow.
Security : Experience in Hadoop security including Kerberos, Knox, and TLS.
Databases : Hands-on experience with SQL and NoSQL databases (HBase) , including performance optimization.
Tools & Automation : Experience in tool integration, automation, and configuration management using GIT and Jira platforms.
Soft Skills : Excellent oral and written communication, presentation skills, and strong analytical and problem-solving abilities.
serp_jobs.job_alerts.create_a_job
Hadoop Admin • Austin, TX, US
Job_description.internal_linking.related_jobs
Head of Robotics
Confidential • Austin, TX, US
serp_jobs.job_card.full_time
Ambitious provider of top-quality services.The Company is seeking a Head of Robotics to lead and define its robotics vision.
This key leadership role involves guiding and growing robotics efforts ac...serp_jobs.internal_linking.show_more
Head of Account Management & Retention.Salesforce-native governance platform for CI / CD, compliance & backup solutions.The Company is in search of a Head of Retention to spearhead its revenu...serp_jobs.internal_linking.show_more
Head of Blockchain Engineering.Well-funded blockchain technology company.Information Technology and Services.The Company is in search of a Head of Blockchain Engineering to take on a pivotal role i...serp_jobs.internal_linking.show_more
University of Texas at Austin • Austin, TX, United States
serp_jobs.job_card.full_time
The University of Texas at Austin is seeking to hire a Team Lead for our Utilities project delivery team within the Planning, Design and Construction (PDC) Department.
PDC is actively managing more ...serp_jobs.internal_linking.show_more
Reputable provider of payment processing software solutions.Information Technology and Services.Information Technology & Services.
The Company is seeking a Head of Compensation Design to lead a ...serp_jobs.internal_linking.show_more
Responsible for implementation and ongoing administration of Hadoop infrastructure.Responsible for cluster maintenance, troubleshooting, monitoring, and following proper backup & recovery strategie...serp_jobs.internal_linking.show_more
Promising provider of AI-powered secure data classification solutions.Information Technology and Services.The Company is seeking a Head of DevOps to spearhead deployment initiatives within secure g...serp_jobs.internal_linking.show_more
Premier technology organization.Information Technology and Services.The Company is in search of a Head of Product for Data and AI Platforms.
This senior leadership role is pivotal in driving the str...serp_jobs.internal_linking.show_more
Head of Blockchain Product Management.Innovative blockchain technology company.Information Technology and Services.The Company is seeking a Head of Blockchain Product Management to take on a foundi...serp_jobs.internal_linking.show_more
Innovative technology & data platform for brands.Information Technology & Services.The Company is seeking a Head of Client Operations to lead its Client Operations team, which serves as the...serp_jobs.internal_linking.show_more
Head of Data Center Operations.Private Equity–backed data center developer.The Company is in search of a Head of Data Center Operations to spearhead the operational strategy and performance of its ...serp_jobs.internal_linking.show_more
Global Medical Response • Austin, TX, United States
serp_jobs.job_card.full_time
The ESO Systems Administrator is responsible for managing and maintaining ESO software applications to ensure optimal performance and compliance for Emergency Medical Services (EMS) operations.This...serp_jobs.internal_linking.show_more
Our client is searching for an IAM Architect for a position that can be worked almost fully remotely.All candidates must be residents of Texas and work directly for TEKsystems on a W2 basis.Underst...serp_jobs.internal_linking.show_more
Noteworthy virtual waitlist app & queue management platform.Information Technology and Services.The Company is seeking a Head of Customer Success for North America to join their mission of revo...serp_jobs.internal_linking.show_more
Vice President of Product Management, Database Servers & OLTP
Confidential • Austin, TX, US
serp_jobs.job_card.full_time
Vice President of Product Management, Database Servers & OLTP.Innovative provider of open source-based data platforms.The Company is seeking a visionary and results-driven Vice President of Pro...serp_jobs.internal_linking.show_more
Renowned provider of high-quality services in various sectors.The Company is in need of an experienced Head of User-Centred Design (UCD) to take on a senior leadership role within a high-impact pro...serp_jobs.internal_linking.show_more
VP of Field Sales - Payment Automation.Globally acclaimed corporate payments company.Privately Held, Private Equity-backed.
Information Technology & Services.The Company is seeking a Vice Presid...serp_jobs.internal_linking.show_more
Vice President of Hyperscale Sales.Globally-recognized ICT services provider.Information Technology and Services.The Company is seeking a Vice President for Hyperscale Sales in the United States.Th...serp_jobs.internal_linking.show_more