Lead Full-Stack Platform Engineer - KFI Data Platform (Remote)
USD 110K-160K Senior-level Full Time
Tasks
- Act as code owner for IaC data lake and application repos
- Apply infrastructure as code
- Build S3 external tables pipelines
- Design Terraform reusable modules
- Develop Dask based transforms
- Drive CI/CD standards
- Implement SQS and Mongo change stream event pipelines
- Implement acceptance testing using BDD
- Mentor engineers
- Own Snowflake lakehouse ingest architecture
- Respond to incidents
- Set technical vision
- Support legacy systems
- Translate strategy into technical roadmap
Perks/Benefits
- 401k match
- Educational assistance
- Employee referral bonus
- Paid disability leave
- Paid family leave
- Paid time off
- Professional development assistance
Skills/Tech-stack
AWS | AWS IAM | AWS Lambda | Active Directory | Amazon S3 | Amazon SQS | Auth0 | Azure | Azure Active Directory | Azure Queue | Azure Queue Storage | BDD | Behave | CI/CD | CSV | Change streams | Dash | Dask | Datadog | ETL | External tables | Flask | GitLab | High Throughput | High-Throughput Systems | IRSA | Infrastructure as Code | JSON | Legacy System | Legacy system support | Materialized views | MongoDB | MongoDB Atlas | MongoDB change streams | Pandas | Parquet | Python | Queue Storage | SQL | Snowflake | System Support | Terraform | XML | “as-code”
Education
N/A
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R26d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R26d ago
-
AI Tech Lead (m/f) EUR 56K-79KAPI Design | AWS | Authentication | Authentication Protocols | Authorization1-on-1 mentorship | Conferences | Ergonomic workstations | Flexible working hours | GPU compute accessSenior-level Full TimeZagreb, Croatia (Hybrid) R4h ago
-
Machine Learning Research Engineer USD 168K-255KComputer Vision | Computer Vision Research | Distributed Training | Edge Hardware | Machine LearningAI Stipend | Equity | Health insurance coverage | Home office stipend | Parental leaveEntry-level Full TimeRemote (US) R7h ago
-
Machine Learning Research Engineer USD 168K-255KComputer Vision | Distributed Training | Machine Learning | Model Optimization | PyTorchAI Stipend | Equity | Health insurance coverage | Home office stipend | Parental leaveEntry-level Full TimeRemote (US) R7h ago
-
Principal Software Engineer (AI/ML Architect-Engineer) USD 163K-270KAWS | Adversarial Networks | CI/CD | Diffusion Models | Generative AISenior-level Full TimeSeattle,WA,United States R7h ago
-
Forward Deployed Engineer / AI Solutions Architect — RAG USD 160K-220KAWS | Access Control | Autogen | Azure | Citation GroundingCareer advancement | Global team collaboration | Professional development | Remote work collaborationSenior-level Full TimeRemote R8h ago
-
GCP Data & Analytics Engineer/Senior Consultant Specialist INR 2000K-3000KAI machine learning | Access Management | Batch Processing | BigQuery | Clickstream analyticsContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R8h ago
-
Software Engineer - Java Developer EUR 33K-55KAPI Gateway | AWS Lambda | AWS RDS | ActiveMQ | AgileCharity donation matching | Complimentary office refreshments | Flexible working hours | Health and fitness subsidy | Hybrid modelMid-level Full TimeBerlin, State of Berlin, Germany R9h ago
-
JAVA Data Engineering/Associate Director Software Engineering INR 1400K-2400KApache Beam | Apache Flink | Apache Kafka | Apache Spark | Data pipelineFlexible working | Professional developmentMid-level Full TimePune, Maharashtra, India R10h ago
-
AI/ML | Agentic AI | Apache Airflow | Apache Kafka | CI/CDMid-level Full TimeHyderabad, Telangana, India R11h ago
-
AWS | Apache Kafka | Azure | CI/CD | Cloud ComputingCareer development | Coaching | Employee benefit program | Health insurance | Meal vouchersSenior-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R12h ago
-
Data Engineer - Aeroline - Aix-en-Provence EUR 46K-53KData Modeling | ELT | ETL | JavaScript | Palantir FoundryAutonomous training | Employee Representation CSE | Health insurance | Meal vouchers | Profit sharingSenior-level Full TimeAix-en-Provence, Provence-Alpes-Côte d'Azur, France R13h ago
-
Applied AI Engineer INR 1800K-2500KAPI Integration | Access Control | Agent Orchestration | Anthropic API | CrewAIMid-level Full TimeHybrid in Bangalore, India R15h ago
-
Data Engineer CAD 108K-135KAirflow | Apache Spark | Data Modeling | Data Quality | Data ValidationChild care benefits | Commuter benefits | Disability benefits | Family building benefits | Flexible paid time offMid-level Full TimeToronto, Canada R16h ago
-
Senior Data Engineers USD 123K-215KAnsible | Cassandra | Couchbase | Data Modeling | Data QualityCareer development and training | Company Matched Retirement Savings Plan | Confidential counseling | Financial coaching | Free medical dental vision life insurance disability benefitsSenior-level Full TimeNew York, NY, United States R17h ago
-
Analytics Engineer CAD 110K-130KA/B | A/B Testing | Airflow | Apache Spark | AutomationCaregiving support | Family planning support | Flexible vacation | Gender-affirming care | Health care spending accountSenior-level Full TimeToronto, Canada R20h ago
-
Analytics Engineer USD 164K-229KAirflow | Apache Spark | Data Governance | Data Modeling | Data Visualization401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R20h ago
-
Senior Analytics Engineer USD 190K-267KAirflow | Apache Spark | D3.js | Data Governance | Data Modeling401k employer match | Flexible vacation | Healthcare benefits | Mental health and coaching | Paid parental leaveSenior-level Full TimeRemote - United States R20h ago
-
Senior Analytics Engineer CAD 105K-120KAirflow | Apache Spark | D3.js | Data Governance | Data IngestionCaregiving support | Comprehensive medical benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - Ontario, Canada R20h ago
-
Data Engineer AUD 80K-120KAirbyte | ClickHouse | Data Lakes | Data Warehousing | ELTChoice of IT equipment | Diversity and inclusion | Employee discounts | Hybrid working | Team eventsMid-level Full TimeAustralia - Remote R21h ago
-
Senior Machine Learning Engineer - Platform AUD 148K-210KAPI Design | Agent Orchestration | CI/CD | Context Management | Distributed SystemsSenior-level Full TimeAustralia - Victoria - Fully Flexible R21h ago
-
Senior AI Engineer (Python, Node.js) - OP02094 BRL 234K-275KAgile | Data Preparation | Embeddings | Feature Engineering | GenAIHealth insurance coverage | Paid sick days | Paid time off | Remote work | Wellness bonusSenior-level Full TimeSão Paulo, São Paulo, Brazil - … R21h ago
-
AWS DMS | AWS Glue | AWS IAM | AWS Lambda | AirbyteCareer coaching | Certification allowance | Collaborative team culture | Flexible hours | Paid time offSenior-level Full TimeVietnam - Remote R21h ago
-
Senior Data Engineering Manager INR 3000K-3880KAgile | Amazon S3 | Amazon Web Services | Apache Spark | Batch ProcessingHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R21h ago