ETL Engineer

Abu Dhabi, Abu Dhabi, United Arab Emirates

Callsign

Marking a new era in passive authentication, fraud prevention and intelligence. We make digital identity simple and more secure.

View all jobs at Callsign

Apply now Apply later

Russian hacker, Vladimir Leonidovitch Levin, attempted the biggest bank heist the world had ever seen via dial-up internet in 1994, Zia Hayat, Callsign CEO and founder, was hooked - armchair fraud became a real possibility. From this moment, Zia knew he wanted to play a part in stopping the bad guys and securing the internet for all. Founded In 2012, Callsign's mission has been to make Digital Identity simple and secure for everyone and everything. In that time, we've grown to over 200 employees, opened offices in Singapore and Abu Dhabi, been recognised as a WEF Global Innovator and our technology is being used by many of the world's leading financial institutions to keep millions of consumers safe.

But we aren't stopping here. The identity revolution has only just begun, and we are looking to hire the brightest and inquisitive minds to help us make every web, mobile and physical Interaction seamless and secure. If this sounds like you, lets chat.

Responsibilities:

  • Develop and maintain ETL pipelines to extract data from multiple production environments, for ingestion into a data warehouse, and transformation into an analytics layer
  • Transform the data using techniques such as cleaning, aggregating, and filtering to prepare it for analysis and reporting.
  • Proactively improve processes and documentation around data management, ingestion, versioning, and storage
  • Manage internal stakeholders and interface with consumers of the data warehouse, including data science, analytics and governance
  • Develop tooling for internal developers who consume the data (data scientists, business analysts, and technical consultants)
  • Always keeping security, performance, scalability and cost in mind when designing solutions or working on existing ones
  • Develop, maintain and assist with the release of microservices related to data extraction
  • Optimize the performance and scalability of ETL pipelines by choosing appropriate tools and technologies, and by tuning and optimizing data models and data flows.

Requirements

  • Strong experience with multiple database technologies, including SQL and NoSQL
  • Experience developing scalable ETL pipelines that can handle large volumes and throughput of data
  • Experience with data warehousing, management and governance
  • Experience with distributed computing frameworks (Spark, Hadoop or similar)
  • Cloud development (especially the AWS ETL stack: Glue, Athena, S3)
  • 5+ years of collaborative development experience with Python, including CI/CD, version control

About you:

  • Comfortable working in a fast-paced, multi-tasking, evolving environment
  • You strive for technical excellence, collaboration and continuous improvement
  • Able to find and analyze trade-offs and pick practical solutions
  • Proactive in communicating with stakeholders about requirements and pain-points, and then translating these to concrete improvements.

Desirable Skills and Experience:

  • Cloud-native development (kubernetes/helm or similar), familiarity with microservices
  • Experience with streaming frameworks (kafka/flink or similar)
  • Infrastructure-as-code experience (terraform/CloudFormation/pulumi or similar)
  • Static-typed compiled languages like java/scala

Benefits

  • Health Insurance
  • Visa costs including 1 month paid hotel stay
  • Annual Airfare Allowance for the home country
  • 3 months full pay maternity leaves & 2 weeks full pay paternity leaves
  • 25 days of annual leave + Callsign Bank Holiday (not included in holiday allowance)
  • Competitive Salary
  • Gratuity as EOSB
  • If you feel you have the above skills we would love to hear from you!
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  2  0  0
Category: Engineering Jobs

Tags: Athena AWS CI/CD CloudFormation Data management Data warehouse Data Warehousing ETL Flink Hadoop Helm Java Kafka Kubernetes Microservices MLOps NoSQL Pipelines Python Scala Security Spark SQL Streaming Terraform

Perks/benefits: Competitive pay Health care Parental leave

Region: Middle East

More jobs like this