Our top client in the transportation / travel industry is searching for a Data Software Engineer to join their team! This is a unique position, as you will be responsible for product optimization projects, creating workflows to ingest data into our client's Enterprise Data Lake, providing initial Tier 1 support for Databricks workflows, Spark streaming applications, and Azure Function applications within their Cloud Data Engineering ecosystem.
- Must-haves for this position - Databricks, Python, Azure, a strong understanding of Spark architecture, and experience with relational databases (Oracle and SQL Server).
If you have a passion for engineering, working with massive amounts of data, and being a part of a shared service organization that supports multiple engineering teams, this is the role for you!
Team typically goes on site on Wednesdays (not every week) - otherwise remote
Candidates MUST currently live in the Greater St. Louis area (relo is not an option)1+ year contract with benefits available on contract with desire to convert this person to an FTE in the future
Cannot work C2C or 3rd partyRequired :
Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the futureMust reside in St. Louis, Missouri, or the immediate surrounding areaMust have 3 or more years experience in full lifecycle development, end-to-end testing, and data validationApache Spark Fundamentals : Understanding Spark architecture, distributed computing, Data Frames, and Spark SQLExperience with relational databases such as Oracle, SQL Server, Postgres, or Teradata.Hands-on experience supporting applications deployed on Azure services such as Spark, Azure Functions, and Azure SQLExperience writing scalable data pipelines and transformations. (e.g., Python, Scala, or Java)Preferred :
Bachelor's degree in Computer Science, Computer Information Systems, Management Information Systems, or related field preferredExperience with Big Data Solutions and NoSQL DBMSsExperience working with ADLSg2 or other Blob Storage solutionsExperience with change data capture (CDC) and identifying data deltas for incremental data processing. (e.g. SCD type 1 / SCD type 2)Experience with API development and support of Azure functionsExperience with Azure, AWS, or other Public Cloud environmentsExperience with Microsoft Azure platform technologies like Event Hubs, Data Factory, Delta Lake, Cosmos DB, or DevOpsPrior experience leading large-scale projects