Talent.com
GCP Data Engineer--KUMDC5641878
GCP Data Engineer--KUMDC5641878Compunnel Inc. • Columbia, MD, United States
GCP Data Engineer KUMDC5641878

GCP Data Engineer KUMDC5641878

Compunnel Inc. • Columbia, MD, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Data Engineer

Location : Lisle IL, or Columbia MD

Hybrid (4 days in office)

JOB FUNCTIONS

Responsibilities

  • Work closely with various business, IT, Analyst and Data Science groups to collect business requirements.
  • Design, develop, deploy and support high performance data pipelines both inbound and outbound.
  • Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Implement CI / CD pipelines to ensure continuous deployment and delivery of our data products.
  • Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
  • Document the design and support strategy of the data pipelines
  • Capture, store and socialize data lineage and operational metadata
  • Troubleshoot and resolve data engineering issues as they arise.
  • Develop REST APIs to expose data to other teams within the company.
  • Mentor and guide junior data engineers.

Required for All Jobs

  • Performs other duties as assigned
  • Complies with all policies and standards
  • QUALIFICATIONS

    Education

  • Required - Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • Nice to Have - Master’s Degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • Work Experience

  • Minimum 6 years of experience in data engineering solutions such as data platforms, ingestion, data management, or publication / analytics
  • 2 years of experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows
  • Knowledge, Skills and Abilities

  • Expert knowledge on SQL and Python programming
  • Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
  • Experience in tuning queries for performance and scalability
  • Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar.
  • Excellent organizational, prioritization and analytical abilities
  • Have proven experience working in incremental execution through successful launches.
  • Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.
  • Experience working in agile environment.
  • serp_jobs.job_alerts.create_a_job

    Gcp • Columbia, MD, United States

    Job_description.internal_linking.related_jobs
    Senior Data Engineer - Acquisition & Sustainment

    Senior Data Engineer - Acquisition & Sustainment

    Redhorse • Arlington, Virginia, United States, 22201
    serp_jobs.job_card.full_time
    Senior Data Engineer - Acquisition & Sustainment.Now is a great time to join Redhorse Corporation.We are a solution-driven company delivering data insights and technology solutions to customers wit...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Data Engineer

    Data Engineer

    Analytica • Washington, DC, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Analytica is seeking a Data Engineer to support a key, long-term federal government client program and software product.The ideal candidate will be comfortable working in an agile, multi-faceted te...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Senior Classified Data Storage and Backup Engineer

    Senior Classified Data Storage and Backup Engineer

    The Johns Hopkins University Applied Physics Laboratory • Laurel, MD, United States
    serp_jobs.job_card.full_time
    Are you a storage engineer with deep experience managing enterprise data and backup solutions and, safeguarding mission-critical data?. Do you take pride in building secure, scalable storage infrast...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    (2966) Backend Software Engineer (Hybrid)

    (2966) Backend Software Engineer (Hybrid)

    Iamus Consulting • Columbia, Maryland, United States
    serp_jobs.job_card.full_time
    As a Software Engineer, you will be responsible for designing, developing, and implementing complex software capabilities for computer-based systems. Will work closely with other talented engineers ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    GCP Data Engineer KUMDC5641878

    GCP Data Engineer KUMDC5641878

    Compunnel Inc. • Columbia, Maryland, United States
    serp_jobs.job_card.full_time
    Location : Lisle IL, or Columbia MD.Work closely with various business, IT, Analyst and Data Science groups to collect business requirements. Design, develop, deploy and support high performance data...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    PROVATOHR INC • Crystal City, VA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    This is a Hybrid position – 1-2 days per week on-site in Crystal City, VA The Role As a mid-level Data Engineer, you'll be at the forefront of delivering software solutions that directly impa...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    Outlier • Columbia, MD, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    ObGyn

    ObGyn

    GO Staffing • Hanover, Pennsylvania, US
    serp_jobs.job_card.full_time
    ObGyn physician job in Pennsylvania : .Locums - A well renowned group is seeking an OBGYN to assist with a couple of 24-hour in-house call shifts per week. Board Certified or Board Eligible OBGYN.In-...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Engineer (Big Data)

    Software Engineer (Big Data)

    Red Arch Solutions • North Laurel, Maryland, United States
    serp_jobs.job_card.full_time
    Red Arch Solutions is hiring a Software Engineer to join a priority program in Annapolis Junction, Maryland.The Software Engineer shall be responsible for the design, development, test, and sustain...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Finance Buzz • Hampstead, Maryland, US
    serp_jobs.filters.remote
    serp_jobs.job_card.temporary
    Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Cloud Software Engineer Sr

    Cloud Software Engineer Sr

    Elevi Associates • North Laurel, Maryland, United States
    serp_jobs.job_card.full_time
    Because You Deserve More Than Just a Job.To be an ELEVI team player you will need : .You must hold a current Poly clearance. Twelve (12) years experience software engineering experience in programs ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    ThinkTek LLC • Washington, DC, United States
    serp_jobs.job_card.full_time
    ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB).We specialize in providing management and technology consulting services to support the ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Platform Engineer

    Platform Engineer

    Raft • Arlington, VA, United States
    serp_jobs.job_card.full_time
    All of the programs we support require.All work must be conducted within the continental U.Distributed Data Systems, Platforms at Scale, and Complex Application Development, with headquarters in Mc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Buyer

    Buyer

    Shimadzu Scientific Instruments • Columbia, MD, United States
    serp_jobs.job_card.full_time
    Established in 1975, Shimadzu Scientific Instruments is one of the largest suppliers of analytical instrumentation, physical testing, and environmental monitoring systems in the world.Ground-breaki...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Full-Stack Software Engineer Data Pipeline Focus - Fully Cleared

    Full-Stack Software Engineer Data Pipeline Focus - Fully Cleared

    Intelliforce-it Solutions Group • North Laurel, Maryland, United States
    serp_jobs.job_card.full_time
    Make an Impact Where It Matters Most.At Intelliforce, we’re powering mission-critical analytics through data.Full-Stack Software Engineer (Data Pipeline Focus). PAI) for hundreds of mission users.Yo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    AITHERAS, LLC • Arlington, VA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Engineer Salary : $95,000 - $120,000 Travel : 3 days onsite, 2 days work-from-home Onsite Location : Arlington, VA Job Description Scope We are seeking a Data Engineer to support our Diversion ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Full-Stack Software Engineer (Data Pipeline Focus)

    Full-Stack Software Engineer (Data Pipeline Focus)

    Visionist • North Laurel, Maryland, United States
    serp_jobs.job_card.full_time +1
    Active Top Secret (TS / SCI) clearance with polygraph is required.Visionist has an exciting new, fully FUNDED opportunity for a Full-Stack Software Engineer with a focus on Data Pipeline on our large...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Distinguished Data Engineer

    Distinguished Data Engineer

    Capital One • Washington, DC, United States
    serp_jobs.job_card.full_time +1
    Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our abilit...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted