Job Description

As a Senior Azure Databricks Administrator, you will lead the installation, configuration, maintenance, and optimization of our Azure Databricks environment. Collaborating closely with data engineers, data scientists, and stakeholders, you'll ensure the seamless operation of our data analytics platform.

Responsibilities:

1. Install, configure, and maintain Azure Databricks clusters and workspaces.

2. Monitor system performance and troubleshoot issues to ensure high availability and reliability.

3. Implement security best practices and ensure compliance with data governance policies.

4. Optimize and fine-tune Databricks clusters for performance and cost efficiency.

5. Lead the migration of existing legacy workspaces, schemas, and data to new Unity Catalog Environments.

6. Manage the Azure Databricks platform, ensuring availability, reliability, and performance.

7. Implement and maintain security measures to protect sensitive data and ensure compliance with regulations like GDPR or HIPAA.

8. Integrate Databricks with other systems and tools in the data ecosystem, such as data lakes, databases, and visualization tools.

9. Collaborate with data engineers and data scientists to design and implement data pipelines and workflows.

10. Provide technical support and guidance to users and stakeholders.

11. Stay current with Azure Databricks updates, new features, and best practices.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

• 7+ years of experience as a Databricks administrator

• Experience of installation, configuration, maintenance, and optimization of our Azure Databricks environment

• Experience optimizing and fine-tune Databricks clusters

• Experience with DevOps and CI/CD

• Experience working in a retail environment null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.