Data Engineer
As a Data Engineer within North America Supply Chain, you will be a key member of a growing and passionate group focused on collaborating across business and technology resources to drive forward key programs and projects building enterprise data & analytics capabilities across the enterprise. Primary responsibilities include :
- Good understanding and application of modern data processing technology stacks. For example, AWS, Snowflake, SQL, Airflow, SQOOP, DMS, Spark, and building out performant data consumption layers.
- Design and build product features in collaboration with business and IT.
- Design reusable components, frameworks, libraries like User Defined Functions.
- Build continuous integration and test-driven development environment.
- Performance / scalability tuning, algorithms and computational complexity.
- Manage large data sets that are updated multiple times per day.
- Participate in an Agile / Scrum methodology to deliver high-quality software releases every 2 weeks through Sprints.
- Troubleshoot production support issues post-deployment and come up with solutions as required.
Preferred experience includes :
A Bachelor's degree in Business, Information Technology or related field.2+ years' experience in a professional organization collaborating across multiple functions.Familiarity with Agile project delivery methods.Experience with AWS components and services (E.G. EC2, EMR, S3, and Lambda).Experience with Jenkins, Bitbucket / GitHub and scheduling tools like Airflow.Strong programming, Python, shell scripting and SQL.Good understanding of file formats including JSON, Parquet, Avro, and others.Experience with data warehouses / RDBMS like Oracle, Teradata, Snowflake.Experience with data warehousing, dimensional modeling and ETL development.Demonstrable ability to quickly learn new tools and technologies.Exceptional interpersonal and communication skills (written and verbal).