Data engineer serp_jobs.h1.location_city
serp_jobs.job_alerts.create_a_job
Data engineer • orange ca
- serp_jobs.job_card.promoted
10025 - Sr. Data Engineer
Hyundai Autoever AmericaFountain Valley, CA, US- serp_jobs.job_card.new
Principal Data Engineer
SkyworksIrvine, CA, USSenior Data Engineer
Second DinnerIrvine, California, United StatesData Engineer
Think TogetherSanta Ana, CA, USData Engineer III (Contract)
Glidewell DentalIrvine, California, United StatesData Center Engineer
Eden Capital CareersIrvine, California, United States- serp_jobs.job_card.promoted
Data Engineer
VirtualVocationsFullerton, California, United States- serp_jobs.job_card.promoted
Senior Data Engineer
Eterna Insurance SolutionsIrvine, CA, US- serp_jobs.job_card.new
Remote Data Engineer
SynergisticITIrvine, CA, US- serp_jobs.job_card.promoted
Data Engineer
MDxHealthIrvine, CA, USData Engineer
JBA InternationalIrvine, California, United StatesSr.Data Engineer
Alignment Healthcare USA, LLCOrange, CA, USBig Data Engineer
Tp-link Systems Inc.Irvine, California, United States- serp_jobs.job_card.promoted
Senior Data Engineer
Turion SpaceIrvine, CA, USSenior Data Engineer
SchoolsFirst Federal Credit UnionTustin, CA- serp_jobs.job_card.promoted
Enterprise Data and Analytics Engineer
TarsanetIrvine, CA, US- serp_jobs.job_card.promoted
Big Data Engineer
TP-Link Systems Inc.Irvine, CA, US- serp_jobs.job_card.promoted
Principal Data Engineer
AmericorIrvine, CA, USSenior Data Engineer
AndurilCosta Mesa, California, United StatesData Engineer - Onsite
eTeamIrvine, CA10025 - Sr. Data Engineer
Hyundai Autoever AmericaFountain Valley, CA, US- serp_jobs.job_card.full_time
Job Description
Job Description
Job Summary
Design, build, and maintain the Information / Proposed Changes platform that enables large-scale data processing and analysis. Responsible for developing and maintaining data pipelines, data lakes, and other data-related platform. Work closely with data scientists, analysts, and other stakeholders to ensure that data is properly collected, stored, and processed for analysis and reporting purposes. Implement and maintain data security and access controls to ensure that data is protected. Responsible for troubleshooting and resolving technical issues related to data infrastructure and ensuring that data systems are scalable and efficient. Play a critical role in enabling organization to derive insights and value from their data assets.
ESSENTIAL FUNCTIONS
- This job requires experience in building and maintaining scalable data pipelines and robust data models from structured and unstructured sources for AI / ML.
- The ideal candidate should have advanced SQL skills and be able to query and transform large structured / unstructured datasets using Spark / PySpark, Spark SQL / Hive and Hive / NoSQL.
- They should also have experience in developing Big Data pipelines in orchestration tools such as Airflow and Oozie, designing tooling for access management, monitoring, data controls, and self-service ETL / Analytics pipelines.
- Other requirements include hands-on experience with On-Prem Big Data Platform, sound knowledge of Distributed Data Processing frameworks, resource management frameworks like YARN, and proficiency in writing data pipelines using Spark, Python and Scala.
- The ideal candidate should also have experience in developing frameworks / utilities in Python, working in a Dev / Ops environment, and following development best practices such as code reviews and unit testing.
- Additionally, the candidate should be able to diagnose software issues and engineering workarounds, have a good understanding of BI tools such as Tableau / Power BI and MicroStrategy for Big Data, and be able to lead, guide and assist team members with project development and problem solving.
- The candidate should also be flexible and able to learn and use new technologies, work well in a team environment as well as independently to achieve goals.
Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.
Required Skills, Attributes & Education
Certifications
Cloudera / Hortonworks / Databricks - Spark / Hadoop certification
Salary Range : $103,170 to $158,873
Powered by JazzHR
t7jF5E65pe