Top Skills' Details:

1) Kafka Architecture Experience - in depth experience with multiple Kafka features

2) TOGAF Architecture Experience

3) Large scale data processing / Big Data Engineering

Description:

Responsibilities

• Design and review architectures of different teams/LOB.

• Create and Publish design patterns for various applications/pipelines for Cloud and On-Prem.

(ETL Pipelines, Data Warehouse, Data Migration, Microservices, Containerization, Data management, Orchestration, Enterprise search, Caching, CDN, multi cloud etc).

• Guiding applications team to follow best practices.

• Create Architectures for different use cases and present to teams and publish to Architecture forum.

• Providing project required training and mentoring to team members

• Providing strategic and tactical direction to the team

• Conduct quality review of project artifacts (design documents, code, etc.)

• Develop automated tools to monitor health checks of the systems.

• 24X 7 Support and maintenance of our customers tier 0 applications (out of 5 Tier-0 apps in bank, i.e. 0 secs down time apps)

• Creating IAD document with continuous updates (versions) with POCs results, assumptions, risks, capacity, infrastructure team discussions, tools/ software changes, project flow changes.

• Requirements gathering and Coding related to Shell scripts, Java, Kafka, MapReduce, Spark, Hive, HBase, Sqoop etc.

• Test automation scripts, Source applications engagement, and deployment coordination with release teams in pre-production and production environments.

• Client interaction, system engineers’ coordination for environment problems, capacity forecast, source application engagement, analyzing source applications data.

• Develop framework to process different file format data using spark and loading into Hive table.

• Spark-SQL coding according to business events and publish the results to business users and make them available in Ambari views.

• Kafka spark streaming for streaming data processing and loading into Hive.

• Webservices (API) integration for Kafka streaming.

• Sqoop data from Teradata and Oracle database and loading into Hive tables.

• Coordinating source application teams for file format, data content, dependencies, data update frequency, production migration, scheduling job in production.

• Coordinating with system engineers on capacity, software upgrades, and environment issues.

• IAD document and user manuals creation and demo to business users to make them understand the framework to explore the data on their own.

• POC to run Spark jobs in AWS EMR cloud.

Skills:

Kafka, Architecture

About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.