Talent.com
Data Engineer
Data EngineerSynechron • Pittsburgh, Pennsylvania, USA
Data Engineer

Data Engineer

Synechron • Pittsburgh, Pennsylvania, USA
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

We are

At Synechron we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechrons progressive technologies and optimization strategies span end-to-end Artificial Intelligence Consulting Digital Cloud & DevOps Data and Software Engineering servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization from Artificial Intelligence and Blockchain to Data Science models Digital Underwriting mobile-first applications and more. Over the last 20 years our company has been honored with multiple employer awards recognizing our commitment to our talented teams. With top clients to boast about Synechron has a global workforce of 14500 and has 58 offices in 21 countries within key global markets.

Our challenge

We are seeking a talented and detail-oriented Data Engineer to design develop and maintain scalable data pipelines and big data solutions. The ideal candidate will have strong expertise in Python PySpark Apache Spark and Big Data technologies. Candidate will work closely with data scientists analysts and stakeholders to ensure data is collected processed and made available for analytics and decision-making.

Additional Information

The base salary for this position will vary based on geography and other accordance with law the base salary for this role if filled within Pittsburgh PA is$105k - $115k / year & benefits (see below).

The Role

Responsibilities :

  • Design develop and optimize large-scale data pipelines using Spark and Python (PySpark).
  • Build and maintain scalable data architecture and infrastructure in big data environments.
  • Collaborate with data scientists and analysts to understand data requirements and deliver reliable data solutions.
  • Extract transform and load (ETL) data from various sources into data lakes or data warehouses.
  • Implement data quality checks validation and monitoring processes to ensure data integrity.
  • Optimize Spark jobs for performance and resource utilization.
  • Automate data workflows and pipelines using scheduling tools like Apache Airflow Luigi or similar.
  • Work with cloud-based big data services (e.g. AWS EMR Azure HDInsight Google Cloud Dataproc) as applicable.
  • Document data pipelines architecture and processes for future maintenance and compliance.
  • Stay updated with emerging big data technologies and industry best practices.

Requirements :

  • Bachelors or Masters degree in Computer Science Data Engineering or related field.
  • Experience in data engineering big data or similar roles.
  • Strong programming skills in Python especially with PySpark.
  • Hands-on experience with Apache Spark (preferably version 2.x or 3.x).
  • Experience working with large-scale data processing frameworks and data lakes.
  • Familiarity with SQL and NoSQL databases.
  • Knowledge of distributed computing concepts and data storage solutions.
  • Experience with cloud platforms such as AWS Azure or Google Cloud is a plus.
  • Knowledge of data modeling data warehousing and ETL best practices.
  • Proficiency with data orchestration tools like Apache Airflow or Luigi.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.
  • Preferred but not required :

  • Experience with Kafka Hadoop Hive or other big data tools.
  • Familiarity with containerization (Docker) and orchestration (Kubernetes).
  • Understanding of data security privacy and compliance standards.
  • Knowledge of streaming data processing and real-time analytics.
  • We offer :

  • A highly competitive compensation and benefits package.
  • A multinational organization with 58 offices in 21 countries and the possibility to work abroad.
  • 10 days of paid annual leave (plus sick leave and national holidays).
  • Maternity & paternity leave plans.
  • A comprehensive insurance plan including medical dental vision life insurance and long- / short-term disability (plans vary by region).
  • Retirement savings plans.
  • A higher education certification policy.
  • Commuter benefits (varies by region).
  • Extensive training opportunities focused on skills substantive knowledge and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
  • Cutting edge projects at the worlds leading tier-one banks financial institutions and insurance firms.
  • A flat and approachable organization.
  • A truly diverse fun-loving and global work culture.
  • S YNECHRONS DIVERSITY & INCLUSION STATEMENT

    Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.

    All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law .

    Candidate Application Notice

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Yearly Salary Salary : 105 - 115

    serp_jobs.job_alerts.create_a_job

    Data Engineer • Pittsburgh, Pennsylvania, USA

    Job_description.internal_linking.related_jobs
    Hadoop Data Engineer (Pittsburgh)

    Hadoop Data Engineer (Pittsburgh)

    Smart IT Frame LLC • Pittsburgh, PA, US
    serp_jobs.job_card.part_time
    We are seeking an accomplished.The ideal candidate will have a strong background in.As a technical leader, you will guide a team of engineers to deliver scalable, secure, and reliable data solution...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Two95 International Inc. • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Type : 6 months (contract to hire).Big Data technology stacks (Apache Nifi, Spark, Kafka, HBase, Hadoop / HDFS, Hive, Drill, Pig, etc. Big Data technology stacks (Hortonworks, Cloudera, etc.Agile...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Data Engineer

    Data Engineer

    Bloomfield Robotics • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    About the Company Bloomfield is a Carnegie Mellon spinout creating a global platform shaping the future of precision agriculture. We scan farms and vineyards at scale (capturing high-resolution imag...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Teradata and Hadoop Developer

    Teradata and Hadoop Developer

    Zone IT Solutions • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Zone IT Solutions is seeking a Teradata and Hadoop Developer to enhance our data solutions team.In this role, you will be responsible for developing and managing large-scale data processing systems...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Advanced Data Engineer

    Advanced Data Engineer

    Naval Nuclear Laboratory • West Mifflin, PA, United States
    serp_jobs.job_card.full_time
    Working at the Naval Nuclear Laboratory we foster pride in belonging to an organization whose culture is made up of these core values : Trust, Empowerment, and Collaboration.Our company promotes a p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Sr. Data Engineer - Snowflake

    Sr. Data Engineer - Snowflake

    Data Ideology • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Ideology At DI, we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business problems for our clients. Our data analytics advisory services en...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Sr Data Engineer

    Sr Data Engineer

    Techstra Solutions • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    The main function of a data engineer is to develop and implement data solutions for data platforms.Coordinate the collection, normalization and analysis of datasets across multiple data platforms.A...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Software Engineer II (Data Services Team) - IDELIC

    Software Engineer II (Data Services Team) - IDELIC

    Innovation Works, Inc. • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    ABOUT IDELIC Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    AI Engineer & Researcher, Inference - Pittsburgh, USA

    AI Engineer & Researcher, Inference - Pittsburgh, USA

    Speechify • Pittsburgh, PA, United States
    serp_jobs.job_card.full_time
    PLEASE APPLY THROUGH THIS LINK : .The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Engineer

    Engineer

    Quality Talent Group • Shaler, Pennsylvania, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Our client is a leading force in advancing safer, smarter AI technology.Their work has been featured in.They’ve built a global community of expert contributors and have already paid out more ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Sr. Cloud Engineer (Pittsburgh)

    Sr. Cloud Engineer (Pittsburgh)

    eNGINE • Pittsburgh, PA, US
    serp_jobs.job_card.part_time
    We are a Solutions and Placement firm shaped by decades of interaction with Technical professionals.Our inspiration is continuous learning and engagement with the markets we serve, the talent we re...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Machine Learning Engineer (Pittsburgh)

    Lead Machine Learning Engineer (Pittsburgh)

    Paladin Consulting • Pittsburgh, PA, US
    serp_jobs.job_card.part_time +1
    Job Title : Machine Learning Lead Engineer.Duration : 6 month Contract-to-Hire.Education / Experience Required : Leading ML / DS projects in an industrial setting, experience working with time-series data...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Data Engineer (Healthcare)

    Sr. Data Engineer (Healthcare)

    Data Ideology • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Ideology At DI, we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business problems for our clients. Our data analytics advisory services en...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Big Data Developer

    Big Data Developer

    Zone IT Solutions • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Zone IT Solutions is on the lookout for a talented Big Data Developer to join our innovative team in Toronto.This role offers an exciting opportunity to work on cutting-edge projects utilizing the ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Sales Engineer

    Sales Engineer

    DQE Communications • Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Sales Engineer DQE Communications, headquartered in Pittsburgh, Pennsylvania, is a fiber-optic Internet and data network access provider for businesses and carriers in Pennsylvania, W...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    AI Engineer

    AI Engineer

    Free Market Health • Pittsburgh, Pennsylvania, United States, 15222
    serp_jobs.job_card.full_time
    Founded in 2019 and headquartered in Pittsburgh, PA, Free Market Health supports forward-thinking payers and specialty pharmacies of all sizes who need to operate in a complex and opaque market.We ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Senior Cloud Engineer (Hybrid)

    Senior Cloud Engineer (Hybrid)

    Dollar Bank, FSB • Pittsburgh, PA, United States
    serp_jobs.job_card.full_time
    Bachelor's degree in computer science, Information Systems, or other related field, or commensurate experience.Cloud platforms like Amazon Web Services, or Microsoft Azure.Scripting via languages l...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Azure data engineer (Pittsburgh)

    Azure data engineer (Pittsburgh)

    Cognizant • Pittsburgh, PA, US
    serp_jobs.job_card.part_time
    Job Title - DataBricks Data Engineer.Must have 8+ years of real hands on experience • •.We are specifically seeking a Data Engineer-Lead with strong expertise in Databricks development.Building and t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted