Technical Data Engineer Lead

Job Title: Senior Data Engineer

Job location: Hybrid 3 days onsite at Capgemini Hub

Job description:

We are looking for a Senior Data Engineer to be part of our scrum teams and perform functional

& system development for Hadoop applications for our Enterprise Data Lake initiative. This is

high visibility fast paced key initiative will integrate data across internal and external sources

provide analytical insights and integrate with our critical systems.

Responsibilities:

• Participate in the agile development process

• Develop functional and technical specifications from business requirements for the commercial platform

• Ensure application quality and adherence to performance requirements

• Help create project estimates and plans.

• Represent engineering team in project meetings and solution discussions

• Participate code review process

• Work with team members to achieve business results in a fast paced and quickly changing environment

• Pair up with data engineers to develop cutting edge

• Analytic applications leveraging Big Data technologies: Hadoop NoSQL and In-memory Data Grids

• Mentor and influence up and down the chain of command

• Support design strategy production promotion processes (DevOps) software change control specifically related to Ab Initio as well as DW technology.

• Hands on Experience in building Ab Initio Graphs.

• Good Knowledge of Databases and hands on experience in writing SQL code.

• Working experience with scheduling tools such as Autosys.

• Perform other duties and/or projects as assigned

Required Skills:

• Bachelor's degree in a quantitative field (such as Engineering Computer Science Statistics Econometrics) and a minimum of 10 years of experience

• Minimum 5 years’ experience working with and developing big data solutions

• Experts in the following Ab Initio tools: GDE Graphical Development Environment Co>Operating System Control Center Metadata Hub Enterprise Meta>Environment Enterprise Meta>Environment Portal Acquire>It Express>It Conduct>It Data Quality Environment Query>It.

• Hands-on experience on writing shell scripts complex sql queries

• Hadoop commands and Git Ability to write abstracted reusable code components

• Programming experience in at least two of the following languages: Scala Java or Python

Desired Characteristics:

• Strong business acumen

• Critical Thinking and Creativity

• Performance tuning experience

• Experience in developing Hive Sqoop Spark Kafka HBase on Hadoop Familiar with Ab Initio Hortonworks Zookeeper and Oozie is a plus

• Willingness to learn new technologies quickly

• Superior oral and written communication skills as well as the willingness to collaborate across teams of internal and external technical staff business analysts’ software support and operations staff.

• Strong business acumen including a broad understanding of Synchrony Financial business processes and practices

• Primary Skills: Hive Sqoop Spark Kafka Secondary Skills:Communication

About Capgemini:

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported in 2022 global revenues of €22 billion.

Get The Future You Want |

Capgemini is an Equal Opportunity Employer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, national origin, sex, gender identity or expression, age, religion, disability, sexual orientation, genetic information, citizenship status, veteran status, marital status, or any other characteristic protected by applicable law.

This is a general description of the duties, responsibilities and qualifications required for this position. Physical, mental, sensory, or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Ref. code: 67429

Posted on: Sep 6, 2024

Experience Level: Experienced Professionals

Contract Type: Permanent

Location:

Westchester - Sogeti US, CA

Brand: Capgemini

Professional Community: Software Engineering

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.