Data Engineer
Location : Hybrid (Houston, TX - Atlanta, GA - Jersey City, NJ - Bay Area CA - Tampa, FL)
Duration : Full Time (12+ months)
Experience Required : 7+ / 10+ yrs. (Mid-Level & Senior Level Positions)
Roles & Responsibilities
- This is a need for someone to build and write the capabilities.
- Experience building and enhance Scala framework and Spark experience
- Design and develop automated testing framework to perform data validation.
- Design and build a high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka.
- Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
- Provide tool support, help consumers troubleshooting pipeline issues.
- Utilizes a thorough understanding of available technology, tools, and existing designs.
Required Qualification :
Good years of experience in application development including Python, SQL, Scala, or Java.2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)2+ years experience with distributed data / computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)2+ years of experience with NoSQL implementation (Mongo, Cassandra)3+ years of experience with UNIX / Linux including basic commands and shell scripting2+ years of experience with Agile engineering practicesIf you are a motivated and skilled DATA ENGINEER with a passion, we invite you to apply at sudheer(at)careits(dot)com for this exciting opportunity.
Compensation : $90,000.00 - $130,000.00 per year