A company is looking for a Data Engineer. Key Responsibilities Design and implement data processing pipelines for real-time and batch data Utilize Python and Spark for ETL workflows and large-scale data loads Ensure data quality and accuracy across various data platforms and integration processes Required Qualifications 5+ years of experience in heavy-volume data processing and data platforms 3+ years of proficiency in Python and Spark 3+ years of hands-on experience with ETL workflows using Spark and Python Experience with SQL / NoSQL databases and data lakes Familiarity with Kafka streams and Databricks or equivalent data platforms
Data Engineer • Worcester, Massachusetts, United States