Job Description
Responsibilities
Bio : The primary responsibility of the Data Engineer is to deliver critical data sources through the expansion of and optimization of data and data pipeline architecture, as well as optimizing data flow and collection. In the roles secondary capacity the position is responsible for developing internal web applications and other means such as SOAP / REST services to gather information from outside sources. Collaboration with various team members, and outside vendors, is essential. This position can be remote in .
- Use PDS to enhance performance within the company through evaluation, planning, and goal execution. Strive to constantly develop oneself as a valuable asset through personal and professional growth and attention to the position’s outcomes.
- Provide leadership, and other functional areas, key measures against all performance based activities. Develop internal web applications and data pull data via a variety of methods to generate KPIs allowing the company to drive for change via statistical data driven measurements.
- Contribute to the overall company growth year over year by providing reliable data and support to all functions within the company. Consolidate data from numerous data repositories and generate easy to use data sources that can be displayed in a variety of ways to help the company make an informative financial decisions.
- Provide data and systems that can be utilized by client groups to improve usability and thus team member’s efficiency of day to day activities. This will lead to improved business decisions and strategic planning.
- Provide tools designed to manage and measure productivity and performance. Employ end user feedback to improve data analysis focused around process-defined utilization.
- Modify and develop custom internal web applications working closely with subject matter experts to identify and define the scope of current and future business requirements and provide system-based solutions. Take requirements and architect database structure following 3NF design and rules. Accountable for the results, performance, and maintenance of applications. Experience with SFTP / FTP service transfer development utilizing .NET via a Windows service. Also develop one-off custom data pulls using SOAP / REST to collect and prepare data from third party systems / vendors.
- Ensure proper data pipeline architecture, as well as optimizing data flow and collection is being implemented and maintained. Review and evaluate existing applications for process that can be better utilized and optimized. Manage the overlapping technical and human-centered disciplines to provide business solutions.
- Ensure organization and proper time-management by following list of priorities and organizing tasks based on this list. Provide timely updates to team member or requestors. Provide weekly priority updates to manager, along with details of non-priority tasks completed.
- Work with the Master Data Team to ensure data is accurate and up to date.
Qualifications / Requirements
MUST
Strong analytical and technical skillsExcellent oral & written communication skillsWorking knowledge of MS Office Products (Word, Excel and Outlook)Bachelor's DegreeDemonstrate the ability to work as a team as well as self-directedCode Languages : SQL (T-SQL), C# and VB (.NET 3.5 and up), XML, JSON, SSIS, SSRS, XHTML, Python, SCALADatabase Engines : SQL Server, DB2, and Azure SQLExperience of .NET and Webapp developmentMicrosoft Cloud Data Platform Azure Data Factory Azure Databricksexperience in developing data ingestion data processing and analytical pipelines for big data relational databases data lake solutions3 years Data engineering experiencePREFERRED
Database Engines : SQL Server, DB2, and Azure SQLExperience in custom ETL developmentAdditional Azure certifications (Associate, Expert, Specialty)Experience with data warehousing and data lake methodologyExperience with Cognos or similar reporting platforms3 years Experience in manufacturing software (ERP, MRP, MPS, WMS)3 years Hands on ERP experienceLI-MD1