Senior Data Engineer

Canton , MA

Job Type: Direct Hire | Recruiter: Ana Chesley (https://digitalprospectors.com/our-team/ana-chesley) | Phone: 603.333.1735

Position: Senior Data Engineer (Azure)

Location: Canton, MA (Remote – candidates must be located on the East Coast)

Length: Direct Hire

Job Description:

Our client is seeking an experienced and highly motivated Senior Data Engineer to join their team. The Senior Data Engineer will play a crucial role in supporting the organization-wide data management and system integration needs. Working cross-functionally with various groups throughout the company, you will integrate internal and external business systems to enhance our data capabilities. The Senior Data Engineer will have the opportunity to design and implement innovative data solutions that drive business insights and operational efficiency.

Essential Duties and Responsibilities (but not limited to):

• Design and build scalable and reliable data infrastructure and pipelines for ingesting, processing, and transforming data from diverse sources.

• Implement data validation and quality checks to ensure accuracy and consistency across all datasets.

• Monitor and maintain the performance of data solutions, including troubleshooting and optimizing queries, data pipelines, and storage systems.

• Design and maintain data models, schemas, and database structures to support reporting and analytics.

• Collaborate with product managers, stakeholders, analysts, and other data engineers to define requirements and data specifications.

• Work alongside network engineers to define networking infrastructure requirements that support data infrastructure and pipelines.

• Collaborate with the security team to ensure all deliverables meet necessary controls and compliance standards regarding data access, security, sensitivity, and confidentiality.

• Perform preliminary assessments of new data sources and assist project managers in estimating effort and refining project scope to identify requirements and tasks.

• Document technical designs, pipelines, datasets, and best practices to ensure clarity and consistency within the team.

• Proactively stay informed of the latest advancements in Azure Synapse, data engineering, data architecture, and data privacy regulations.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, Informatics, Information Systems, or another quantitative field.

• 8+ years of experience in a data engineering role, with expertise in Microsoft Azure cloud services, including Azure Data Factory, Data Pipelines, Data Bricks, Azure Functions, Azure CLI, Integration Runtime, Azure Synapse Analytics, SQL Pools, SQL Database, Dataverse, and data warehousing.

• Proficient in Python, pySpark, SQL, and ETL development; experience with Azure Networking, VNets, DNS, routing, load balancing, and security.

• Familiarity with agile methodologies, Azure DevOps, Azure Repos, and CI and CD pipelines for automating build, test, and deployment processes.

• Familiarity with Visual Studio, REST APIs, C#, .NET Core, and JavaScript.

• Strong communication and collaboration skills, with the ability to work effectively in a remote, cross-functional team environment.

• Experience with Dynamics 365 Finance and Operations and Sales data is a plus.

• Experience in a regulated environment (SOX, GxP, HIPAA, etc.) is a plus.

POST-OFFER BACKGROUND CHECK IS REQUIRED. Digital Prospectors is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by law. Digital Prospectors affirms the right of all individuals to equal opportunity and prohibits any form of discrimination or harassment.

Come see why DPC has achieved:

• 4.9/5 Star Glassdoor rating and the only staffing company (< 1000 employees) to be voted in the national Top 10 ‘Employee’s Choice - Best Places to Work’ by Glassdoor.

• Voted ‘Best Staffing Firm to Temp/Contract For’ seven times by Staffing Industry Analysts as well as a ‘Best Company to Work For’ by Forbes, Fortune and Inc. magazine.

As you are applying, please join us in fostering diversity, equity, and inclusion by completing the Invitation toSelf-Identify (https://www.paycomonline.net/v4/ats/web.php/jobs/ViewJobDetails?job=78910&clientkey=55336DD43EED5DE3CE2A2212C8A1FA1B) form today!

www.LoveYourJob.com