Talent.com
Databricks Data Engineer - Manager - Consulting - Location Open 1
Databricks Data Engineer - Manager - Consulting - Location Open 1Ernst & Young Oman • Palo Alto, CA, United States
[error_messages.no_longer_accepting]
Databricks Data Engineer - Manager - Consulting - Location Open 1

Databricks Data Engineer - Manager - Consulting - Location Open 1

Ernst & Young Oman • Palo Alto, CA, United States
[job_card.1_day_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Technology – Data and Decision Science – Data Engineering – Manager

Location : Anywhere in Country

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data architecture, cloud technologies, and analytics, along with exceptional leadership and client management skills.

The opportunity

In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions.

  • Understanding and analyzing business requirements to translate them into technical requirements.
  • Designing, building, and operating scalable data architecture and modeling solutions.
  • Staying up to date with the latest trends and emerging technologies to maintain a competitive edge.

Key Responsibilities

  • Leading workstream delivery and ensuring quality in all processes.
  • Engaging with clients on a daily basis, actively participating in working sessions, and identifying opportunities for additional services.
  • Implementing resource plans and budgets while managing engagement economics.
  • This role offers the opportunity to work in a dynamic environment where you will face challenges that require innovative solutions. You will learn and grow as you guide others and interpret internal and external issues to recommend quality solutions. Travel may be required regularly based on client needs.

    Skills and attributes for success

  • Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP).
  • Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices.
  • Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement.
  • Collaborate with clients to understand their analytics needs and deliver tailored solutions that drive business value.
  • Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance.
  • Drive end-to-end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services.
  • Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts and project progress.
  • Manage client relationships and expectations, ensuring high levels of satisfaction and engagement.
  • Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics.
  • Strong analytical and problem-solving abilities.
  • Excellent communication skills, with the ability to convey complex information clearly.
  • Proven experience in managing and delivering projects effectively.
  • Ability to build and manage relationships with clients and stakeholders.
  • To qualify for the role, you must have

  • Bachelor’s degree in computer science, Engineering, or a related field required; Master’s degree preferred.
  • Typically, no less than 4 - 6 years relevant experience in data engineering, with a focus on cloud data solutions and analytics.
  • Proven expertise in Databricks and experience with Spark for big data processing.
  • Strong background in data architecture and design, with experience in building complex cloud analytics solutions.
  • Experience in leading and managing teams, with a focus on mentoring and developing talent.
  • Strong programming skills in languages such as Python, Scala, or SQL.
  • Excellent problem-solving skills and the ability to work independently and as part of a team.
  • Strong communication and interpersonal skills, with a focus on client management.
  • Required Expertise for Managerial Role

  • Strategic Leadership : Ability to align data engineering initiatives with organizational goals and drive strategic vision.
  • Project Management : Experience in managing multiple projects and teams, ensuring timely delivery and adherence to project scope.
  • Stakeholder Engagement : Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively.
  • Change Management : Skills in guiding clients through change processes related to data transformation and technology adoption.
  • Risk Management : Ability to identify potential risks in data projects and develop mitigation strategies.
  • Technical Leadership : Experience in leading technical discussions and making architectural decisions that impact project outcomes.
  • Documentation and Reporting : Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients.
  • Large-Scale Implementation Programs

  • Enterprise Data Lake Implementation : Led the design and deployment of a cloud-based data lake solution for a Fortune 500 retail client, integrating data from multiple sources (e.g., ERPs, POS systems, e-commerce platforms) to enable advanced analytics and reporting capabilities.
  • Real-Time Analytics Platform : Managed the development of a real-time analytics platform using Databricks for a financial services organization, enabling real-time fraud detection and risk assessment through streaming data ingestion and processing.
  • Data Warehouse Modernization : Oversaw the modernization of a legacy data warehouse to a cloud-native architecture for a healthcare provider, implementing ETL processes with Databricks and improving data accessibility for analytics and reporting.
  • Ideally, you’ll also have

  • Experience with advanced data analytics tools and techniques.
  • Familiarity with machine learning concepts and applications.
  • Knowledge of industry trends and best practices in data engineering.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
  • Knowledge of data governance and compliance standards.
  • Experience with machine learning frameworks and tools.
  • What we look for

    We seek individuals who are not only technically proficient but also possess the qualities of top performers, including a strong sense of collaboration, adaptability, and a passion for continuous learning. If you are driven by results and have a desire to make a meaningful impact, we want to hear from you.

    What we offer you

    At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more .

  • We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $125,500 to $230,200. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $150,700 to $261,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.
  • Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year.
  • Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter / Summer breaks, Personal / Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
  • Are you ready to shape your future with confidence? Apply today.

    EY accepts applications for this position on an on-going basis.

    For those living in California, please click here for additional information.

    EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.

    EY | Building a better working world

    EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

    Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

    EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

    EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity / expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.

    EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com .

    #J-18808-Ljbffr

    [job_alerts.create_a_job]

    Manager Location • Palo Alto, CA, United States

    [internal_linking.related_jobs]
    Lead Azure Databricks Engineer

    Lead Azure Databricks Engineer

    Fractal • Palo Alto, CA, United States
    [job_card.full_time]
    Fractal Analytics is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and...[show_more]
    [last_updated.last_updated_variable_hours] • [promoted] • [new]
    Staff / Principal Data Platform & Analytics Engineer

    Staff / Principal Data Platform & Analytics Engineer

    PROCEPT BioRobotics • San Jose, California, United States, 95101
    [job_card.full_time]
    Staff / Principal Data Platform & Analytics Engineer.Embark on an enriching journey with PROCEPT BioRobotics, where our vision, mission, and values guide everything we do as a company.At PROCEPT, we ...[show_more]
    [last_updated.last_updated_variable_days]
    Sr. Sales Manager (27295)

    Sr. Sales Manager (27295)

    Supermicro • San Jose, CA, United States
    [job_card.full_time]
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Data analytics Architect

    Data analytics Architect

    MOTOCOL • San Jose, CA, United States
    [job_card.full_time]
    Our client is seeking a senior software architect with at least 8 years of experience in designing scalable, distributed systems to join the Data Analytics Team. This role is expected to provide arc...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Analytics Manager

    Analytics Manager

    Argyle Infotech • Sunnyvale, CA, US
    [job_card.full_time]
    Location : Hybrid - Sunnyvale, CA.Responsible for defining, enforcing and promoting policies.[show_more]
    [last_updated.last_updated_30] • [promoted]
    Palantir Engineer - Senior - Consulting - Location Open

    Palantir Engineer - Senior - Consulting - Location Open

    Ernst & Young Oman • Palo Alto, CA, United States
    [job_card.full_time]
    At EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Data Platform Engineer, Analytics & AI

    Senior Data Platform Engineer, Analytics & AI

    Apple Inc. • Cupertino, CA, United States
    [job_card.full_time]
    A leading technology company in Cupertino, California, seeks a Senior Software Engineer for its Data Science & Analytics Platform team. The ideal candidate will lead platform engineering efforts, en...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Enterprise Data and Analytics Manager

    Enterprise Data and Analytics Manager

    Elastic • Mountain View, CA, United States
    [job_card.full_time]
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Lead Data Engineer

    Lead Data Engineer

    Mentor Talent Acquisition • Sunnyvale, CA, United States
    [job_card.full_time]
    We’re looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AWS Data Migration consultant / Data Engineer

    AWS Data Migration consultant / Data Engineer

    SRS Consulting Inc • San Jose, CA, US
    [job_card.full_time]
    Role : AWS Data Migration consultant / Data Engineer.Duration : 3 month + Possible extension.We're seeking an experienced consultant for a focused 2-3 month engagement to migrate data transformation ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Master Data Governance / Management - Senior Manager - Consulting - Location OPEN

    Master Data Governance / Management - Senior Manager - Consulting - Location OPEN

    EY • Palo Alto, CA, United States
    [job_card.full_time]
    Master Data Governance / Management - Senior Manager - Consulting - Location OPEN.EY's Analytics and Data team is seeking a Master Data Management Senior Manager focusing on helping our clients defin...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    MlOps / Data Engineer

    MlOps / Data Engineer

    TEKsystems • Cupertino, CA, United States
    [job_card.full_time]
    Expected skills : Python, Golang / Rust (nice to have).Data Engineering tools : pyiceberg, daft to name a few.The candidate should be familiar with data engineering supporting and building systems at P...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Staff Data Engineer

    Staff Data Engineer

    Mentor Talent Acquisition • Palo Alto, CA, United States
    [job_card.full_time]
    You’ll take full ownership of data at a healthtech company with millions of lives to impact : setting architecture, choosing tools, and building the entire data platform from scratch.You’ll be the f...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Data Engineer

    Data Engineer

    Midjourney • Fremont, CA, United States
    [job_card.full_time]
    Midjourney is a research lab exploring new mediums to expand the imaginative powers of the human species.We are a small, self-funded team focused on design, human infrastructure, and AI.We have no ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior Databricks Data Engineer & Team Lead (Remote)

    Senior Databricks Data Engineer & Team Lead (Remote)

    Ernst & Young Oman • Palo Alto, CA, United States
    [filters.remote]
    [job_card.full_time]
    A global consulting firm seeks a Manager of Data Engineering in Palo Alto.The role involves leading complex cloud analytics solutions using Databricks, mentoring data engineers, and engaging with c...[show_more]
    [last_updated.last_updated_1_day] • [promoted]
    Databricks Data Architect

    Databricks Data Architect

    DynPro Inc. • San Jose, CA, United States
    [job_card.full_time]
    This range is provided by DynPro Inc.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Direct message the job poster from DynPro Inc.Tech Recruiti...[show_more]
    [last_updated.last_updated_30] • [promoted]
    ERCS Data & Tech - AI Engineer - Senior Manager

    ERCS Data & Tech - AI Engineer - Senior Manager

    PwC • Palo Alto, CA, United States
    [job_card.full_time]
    ERCS Data & Tech - AI Engineer - Senior Manager.At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analyt...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Analytics Engineer, Data Organization

    Analytics Engineer, Data Organization

    OSI Engineering • Cupertino, California, United States
    [job_card.full_time]
    A globally leading consumer device company headquartered in Cupertino, CA is looking for Analytics Engineer to build data and tools that enable analytics to inform product and engineering teams at ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]