Expire in: 22 days
Hays are now looking for a Databricks Consultant / SME for one of our local clients:
Flexible rate - Outside IR35
1 day a week in Swindon, the rest is WFH
Initial 6 month contract (extensions likely)
We're seeking a highly experienced Databricks specialist who can confidently navigate the platform end-to-end, including leading migrations from legacy setups using DBFS-mounted tables and Hive Metastore. You'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise.
What you'll be doing
Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS to Unity Catalog
Define and implement a scalable, standardised migration approach across teams
Support teams with ad-hoc Databricks issues related to migration and platform usage
Optimise the Databricks environment for structure, access, and governance
Automate infrastructure and deployments using Terraform and/or CloudFormation
Build and maintain data pipelines using Python, SQL and Databricks APIs
Monitor platform performance using tools such as CloudWatch, Grafana, and Kibana
Collaborate with engineering teams, stakeholders, and platform users
What we're looking for
Strong hands-on experience with Databricks in an AWS environment
Proven experience with Unity Catalog and Databricks migrations
Strong Python skills and experience working with Databricks APIs
Solid understanding of data pipelines, SQL, and data platform architecture
Experience with Infrastructure as Code (Terraform or CloudFormation)
Knowledge of monitoring and observability tools (e.g. CloudWatch, Grafana, Kibana)
Strong problem-solving skills and ability to work independently
Excellent communication and stakeholder engagement skills
Exposure to Databricks Apps or AI/ML workloads (nice to have)
If you have previously led migrations to Unity Catalogue and you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or please send a copy of your CV to
Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)Do not include the following in your job application, CV, or cover letter:
You should not be asked for payment or irrelevant information. If you have concerns about a job advert or employer, seek guidance on how to proceed.
Looking for your next career move? Join a top company hiring Databricks Consultant (UC Migration) job near me in Swindon, Wiltshire! This is your chance to work on exciting projects, grow professionally, and enjoy a rewarding career with competitive pay and excellent benefits. Whether you're an experienced professional or looking to take the next step, this role offers the perfect opportunity to enhance your skills and make an impact. Don’t miss out—apply today via Vita CV and take your career to the next level!
© Vita CV: Registered in England and Wales (16187919).
Vita CV uses cookies to enhance your experience, analyze site traffic, and personalize content. By continuing to browse, you agree to our use of cookies.