Sr. Data Engineer :

Primary Skills : Python (Advanced), PySpark (Advanced), Databricks (Intermediate), AWS (Intermediate), ETL (Intermediate)

Contract Type : W2 Only

Duration : 12+ Months

Location : San Francisco, CA

Pay Range : $85 - $95 per hour on W2

Job Summary :

We are seeking an Expert Data Engineer to join our dynamic team to design, develop, and maintain efficient and robust data pipelines ensuring high-quality, curated, trusted, and actionable data. This role involves collaborating with cross-functional teams to understand their data requirements and employing a security-first and automated approach to data engineering practices. The ideal candidate will proactively resolve issues in data pipelines and analytical stores, ensuring system reliability and employing the latest technologies to enhance data engineering processes.

Key Responsibilities :

Design and develop scalable and secure data pipelines, ensuring efficient data ingestion, transformation, and delivery.

Participate actively in Agile rituals, adhering to Scaled Agile and Safe Agile Practices for data product and service delivery.

Proactively identify and resolve data pipeline and data store issues employing monitoring, alerting, and auto-remediation.

Collaborate with cross-functional teams to meet their data infrastructure and tool requirements.

Keep abreast of and implement the latest data engineering technologies, tools, and best practices.

Must-Have Skills :

Advanced proficiency in Python and PySpark.

Experience with cloud data warehouses (e.g., RedShift, Snowflake) and modern data stack technologies (e.g., S3, Airflow).

Proven track record of building end-to-end data pipelines using Spark architecture.

Required Domain Experience :

Extensive data engineering experience, both on-prem and in the cloud (specifically AWS), is essential for this role. Prior experience in a fast-paced, technology-driven environment would be advantageous.

Additional Requirements :

This position is open to Protected Individuals as defined, including U.S. citizens, nationals, and permanent residents.

ABOUT AKRAYA

Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!

Industry Leaders in IT Staffing

As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!

Join Akraya Today!

Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!