Sr. Developer - Automated Detection
Bengaluru
Arctic Wolf
Arctic Wolf delivers dynamic 24x7 cybersecurity protection tailored to the specific needs of your organization. Ready to boost your security posture?The Senior Developer - Detection Automation will partner with high-powered security and detection research teams to create automated detection pipelines for our suite of cybersecurity products and services. They will partner with researchers as a data engineer, familiar with SQL, Spark, and either/both of Databricks or Athena/Iceberg/Trino to write and optimize ETL/ELT jobs to ingest raw data from a variety of sources, refine that data, and optimize/tune those datasets into production. They should be comfortable with relational- and non-relational databases like SQL and PostgreSQL, big data systems such as Spark, and cloud-deployments of software and ETL jobs in AWS. Workflow orchestrators such as Airflow will also be used. Knowledge of cybersecurity and detection engineering are a bonus.
Arctic Wolf Labs is the research-focused division at Arctic Wolf focused on advancing innovation in the field of security operations. The mission of Arctic Wolf Labs is to develop cutting-edge technology and tools that are designed to enhance the company’s core mission to end cyber risk, while also bringing comprehensive security intelligence to Arctic Wolf’s customer base and the security community-at-large. Leveraging the more than two trillion security events the Arctic Wolf Security Operations Cloud ingests, parses, enriches, and analyzes each week, Arctic Wolf Labs is responsible for performing threat research on new and emerging adversaries, developing advanced threat detection models, and driving improvement in the speed, scale, and detection abilities of Arctic Wolf’s solution offerings. The Arctic Wolf Labs team comprises security and threat intelligence researchers, data scientists, security development engineers with deep domain knowledge in artificial intelligence (AI), security R&D, as well as advanced threat offensive and defensive methods and technologies. Security Research Services Development partners with these groups to understand requirements, design & implement scalable, fault-tolerant solutions, and build the next generation of security capabilities for Arctic Wolf.
AS A SENIOR DEVELOPER – DETECTION AUTOMATION AT ARCTIC WOLF, YOU WILL:
Execute on R&D of distributed, highly scalable, and fault-tolerant microservices
Use test-driven development techniques to develop beautiful, efficient, and secure code
Create and scale high-performance services that bring new capabilities to Arctic Wolf’s data science organizations
Identify problems proactively and propose novel solutions to solve them
Continuously learn and expand your technical horizons
WE’RE LOOKING FOR SOMEONE WHO
Will collaborate closely with our data science and detection research teams across different cybersecurity domains to define research detection infrastructure requirements and build critical data services.
Has proficiency in big data technologies such as Apache Spark, Databricks, Kafka, SQL, Terraform.
Has experience interacting with and author workflows, such as prompts or tools, for LLMs, in AWS Bedrock
Has extensive experience with data pipelines tools (Flink, Spark or Ray) and orchestration tools such as Airflow, Dagster or Step Functions
Has knowledge of Data Lake technologies, data storage formats (Parquet, ORC, Avro), and query engines (Athena, Presto, Dremio) and associated concepts for building optimized solutions at scale
Maintains an expert level in one of the following programming languages or similar- Python, Java, Go, Scala
Is an expert in implementing data streaming and event-based data solutions (Kafka, Kinesis, SQS/SNS or the like)
Has experience interacting with and engineering workflows with LLMs, including Prompts
Has experience deploying software with CI / CD tools including Jenkins, Harness, Terraform etc.
Has hands-on experience implementing data pipeline infrastructure for data ingestion and transformation near real-time availability of data for applications and ETL pipelines
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Athena Avro AWS Big Data Dagster Databricks Data pipelines ELT Engineering ETL Flink Java Jenkins Kafka Kinesis LLMs Microservices Parquet Pipelines PostgreSQL Python R R&D RDBMS Research Scala Security Spark SQL Step Functions Streaming TDD Terraform
Perks/benefits: Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.