NCDPI - Technical Architect- Senior

Typical Experience : 60-84 months

• This is an onsite position.

Job Title : Data Engineer - Azure Platform

Overview :

We are looking for an experienced Data Engineer tojoin our team. You will use various methods to import raw data into AzureCloud. You will analyze data and create rules for the ETL process. The importprocess will also include identifying the business rules and apply them to thefiles stored in staging area before moving the files to processed area.

The ideal candidate will have a strong background indata engineering, along with expertise in cloud computing. This role offers anexciting opportunity to play a key role in modernizing our technology stack anddriving our organization's digital transformation journey.

Responsibilities :

Collaborate with cross-functional business teams tounderstand requirements, analyze, and organize raw data import by identifyingthe ETL rules.

Identify and apply transformation rules for legacydata migration from mainframe systems to the Azure cloud platform.

Develop and implement data pipelines, ETL processes,and data integration solutions to facilitate the conversion of data.

Develop and maintain documentation, best practices,and standards for data engineering processes and procedures.

Provide technical leadership and mentorship to teammembers, guiding them in best practices for data engineering and cloudmigration projects.

Explore ways to enhance data quality and reliability.

Requirements and Skills

1.

2.

3.

4.

5.

6.

7.

Additionally, obtaining relevant certifications, such as theMicrosoft Certified : Azure Data Engineer Associate, can further validate andenhance these skills.

Qualifications :

Bachelor's degree in computer science, Engineering, ora related field

Proven experience as a data engineer, with a strongfocus on data migration, ETL, and data integration.

Hands-on experience with data warehousing concepts,database technologies (SQL on Azure)

Strong problem-solving skills, attention to detail,and the ability to work effectively in a fast-paced environment.

Excellent communication and interpersonal skills, withthe ability to collaborate effectively with cross-functional teams andstakeholders.

Required / Desired Skills

SkillRequired / DesiredAmountof ExperienceProficiency in designing and implementing relational and non-relational databases.Required5YearsKnowledge of data modeling techniques and tools.Required5YearsHands-on experience with Azure data services such as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage, etc.Required5YearsExpertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks.Required5YearsKnowledge of data integration and transformation techniques.Required5YearsProficient in writing complex SQL queries and stored proceduresRequired5YearsKnowledge of data security best practices and experience implementing security measures for data storage and processing on Azure.Required5YearsAbility to set up monitoring and logging for data pipelines and databases.Required5YearsSkills in optimizing data storage and processing for performance and cost-effectivenessRequired5YearsProficiency in scripting languages like Python or PowerShell for automating data engineering tasksRequired5YearsKnowledge of Azure Resource Manager (ARM) templates for infrastructure as codeRequired5Years

Questions

No.QuestionQuestion1Absences greater than two weeks MUST be approved by CAI management in advance, and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you accept this requirement?Question2All work must be completed on-site. Do you accept this requirement?Question3Candidate must be able to attend an in-person interview. Do you accept this requirement?Question4Please list candidate's email address. Question5Please indicate how soon this candidate is available to start work. Vendors are encouraged to submit candidates that are available for the duration of the assignment.Question6Vendor must disclose to the agency if the candidate will be subcontracted at the time of submission. Do you accept this requirement?Question7Vendor must notify the agency if any portion of the requirements listed in this task order is to be outsourced to other countries. Do you accept this requirement?Question8Candidates submitted above the rate of $$ will not be considered. Do you accept this requirement? Question9Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked by the engaged resource. It is the responsibility of the supplier to adhere to any applicable compensation laws including payment for overtime hours. Do you accept this requirement?Question10Please confirm you have thoroughly validated, and attest to the accuracy of, the credentials listed throughout this candidate's VectorVMS profile and resume pursuant to Section 5.2.5 of ITS-009440. Do you confirm?