Databricks Administrator

GBR LNDN 25 Walbrook FL5&6

Apply now Apply later

Senior Databricks Administrator | London


Are you ready to write your next chapter?

Make your mark at one of the biggest names in payments. With proven technology, we process the largest volume of payments in the world, driving the global economy every day. When you join Worldpay, you join a global community of experts and changemakers, working to reinvent an industry by constantly evolving how we work and making the way millions of people pay easier, every day.
 

What makes a Worldpayer? It’s simple: Think, Act, Win. We stay curious, always asking the right questions to be better every day, finding creative solutions to simplify the complex. We’re dynamic, every Worldpayer is empowered to make the right decisions for their customers. And we’re determined, always staying open – winning and failing as one.

About the team
Worldpay Cloud Data Platform team provides WorldPay big Data capabilities including large scale data processing, analytics, fraud platforms, machine learning engineering, stream processing and data insights. Worldpay Cloud Data Platform team help maintain and advance cloud data platforms and services to build data products powering our business services and customers.

What you'll Own
 

· Run Databricks at a workspace and account level.

· Set up and advise on architecture and scaling for the Databricks environment, including administering, configuring and installing libraries.

· Monitor and manage the Databricks workspace, clusters, Tenants, including workspace creation, user management, cloud resources, account usage and jobs

· Ensure high availability and performance of the Databricks environment

· Implement and maintain Databricks clusters, including auto-scaling, configuration, and tuning.

· Manage user access and permissions, ensuring data security and compliance with company policies.

· Implement and monitor security controls, including encryption, authentication, and network security.

· Conduct regular security audits and vulnerability assessments.

· Manage data ingestion and ETL processes within Databricks.

· Integrate Databricks with other data sources and tools, such as data lakes, warehouses, and BI tools.

What you’ll bring

5+ years of experience working as Databricks administrator/architect

· Proficiency in cloud platforms such as AWS, Azure, or Google Cloud.

· Strong fluency with Python or Java

· Serving as the Databricks account owner, including security and privacy setup, marketplace plugins and integration with other tools

· Experience Unity Catalog migration, workspaces and audit logs

· Strong experience with Amazon Web Services (AWS) accounts and high-level usage monitoring

· Proficiency in scripting languages such as Python, Bash, or PowerShell.

· Experience with CI/CD tools like Jenkins, GitLab CI, CircleCI, or similar.

· Familiarity with monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack).

· Excellent problem-solving skills and attention to detail.

· Strong communication skills and the ability to work collaboratively in a team environment.

· Experience with AWS CLI and Networking

· Experience with architecting and maintaining high availability production systems

· Experience with developing monitoring architecture and implementing monitoring agents, dashboards, escalations, and alerts

· Knowledge of security controls for the public cloud (encryption of data in motion/rest and key management)

· Demonstrated knowledge and hands-on experience with AWS alerting/monitoring tools

· Experience with infrastructure as code (IaC) tools such as Terraform.

Worldpay perks - what we’ll bring for you

We know it’s bigger than just your career. It’s your life, and your world. That’s why we offer global benefits and programs to support you at every stage. Here’s a taste of what you can expect.

  • A competitive salary and benefits.
  • Time to support charities and give back to your community.
  • Parental leave policy.
  • Global recognition platform.
  • Virgin Pulse access.
  • Global employee assistance program.

Privacy Statement

Worldpay is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how Worldpay protects personal information online, please see the Online Privacy Notice.

Sourcing Model

Recruitment at Worldpay works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. Worldpay does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.

#pridepass

Apply now Apply later
  • Share this job via
  • 𝕏
  • or

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Architecture AWS Azure Big Data CI/CD Databricks ELK Engineering ETL GCP GitLab Google Cloud Grafana Java Jenkins Machine Learning Privacy Python Security Terraform

Perks/benefits: Career development Competitive pay Gear Parental leave

Region: Europe
Country: United Kingdom

More jobs like this