DataBricks Engineer with Epic and Fabric

Job Title : DataBricks Engineer with Epic & MS Fabric

Location : Remote

Duration : Contract- 3-12 months

Job Summary : BigRio LLC is seeking a highly skilled and business-savvy DataBricks Engineer to join our team. In this role, you will leverage your deep technical expertise in DataBricks and your understanding of business processes to help guide our company toward the most effective data solutions. You will work closely with stakeholders across the organization to understand their needs and help in implementation and integration.

Key Responsibilities :

• Business Requirement Analysis : Collaborate with business stakeholders to understand their data needs and objectives. Translate these business requirements into technical specifications for DataBricks solutions that align with the company's goals.
• Solution Design and Architecture : Lead the design and architecture of scalable, high-performance data solutions using DataBricks. Ensure that solutions are aligned with best practices and industry standards.
• Data Integration : Oversee the integration of various data sources into the DataBricks environment. Ensure data is cleansed, transformed, and available for analysis and reporting.
• Performance Optimization : Monitor and optimize the performance of DataBricks environments. Implement best practices for data processing, storage, and retrieval to ensure optimal system performance.
• Compliance and Security : Ensure that all DataBricks solutions comply with relevant industry regulations and data security standards.

Qualifications :

Education : Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field. A Master's degree is preferred.

Experience : A minimum of 7 years of experience in data engineering, data architecture, or a related field, with significant experience using DataBricks. Experience in understanding and translating business requirements into technical solutions is essential.

Experience with Epic System and MS Fabric

Technical Expertise :

Proficient in DataBricks, including cluster management, data pipelines, and advanced analytics.

Strong knowledge of big data technologies (e.g., Apache Spark, Hadoop).

Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions.

Familiarity with programming languages such as Python, SQL, and Scala.

Preferred Qualifications :

Experience in the healthcare, hospital, clinics or providers.

Certifications in DataBricks, AWS, Azure, or other relevant technologies.

Experience with machine learning and AI technologies within the DataBricks environment.