Data Engineer

Job Description : Supports engineering projects by developing software solutions; conducting tests and inspections; preparing reports and calculations. Expected to supervise associate engineers on occasion. Understands system protocols, how systems operate and data flows. Aware of current technology benefits. Expected to independently develop a full software stack. Understands the building blocks, interactions, dependencies, and tools required to complete software and automation work. Independent study of current technology.

Note : Need a Senior Data Engineer(Individual contributor) who can guide team members, contribute to design, and bring new ideas with minimal client guidance.

Primary Skills :

PySpark

Databricks

Python

SQL / Data Manipulation

Data Modelling

Secondary Skills :

AI / ML

DevOps

Technical Leadership

Collaborates with technical teams and utilizes system expertise to deliver technical solutions.

Continuously learns new technologies.

Technical Writing

Writes basic documentation on how technology works. Contributes clear documentation for new code and systems used.

Documenting systems designs, presentations, and business requirements for consumption at the engineer level.

Technology Strategy

Contributes to emerging technologies to deliver business goals.

Understands current technology that supports business goals. Understands system protocols, how systems operate and data flows. Aware of current technology benefits. Expected to independently develop a full software stack. Understands the building blocks, interactions, dependencies, and tools required to complete software and automation work. Independent study of current technology is expected. Interact with system engineers to define system requirement and / or necessary requirements for automation.

Innovation

Presents new ideas which improve an existing system / process / service utilizing new frameworks.

Express new perspectives based on independent study of the industry.

Review current company processes to highlight questions that may drive process refinement.

Education :

Bachelor's Degree Computer Science or Engineering (Required)

Work Experience :

2-4 years Technical engineering experience. (Required)

2-4 years Data Modeling, Data Analysis, Software / Functional Design. (Strongly Preferred)

Knowledge, Skills and Abilities :

Databricks (Required)

PySpark (Required)

Python (Required)

SQL / Data Manipulation (Required)

Azure Cloud Storage (Preferred)

Shell scripting (Preferred)

Devops Experience

AI / ML added advantage

Communication (Required)

Customer Service (Required)

Analytics (Required)

Technical Writing (Required)