Data Platform Engineer
Tasks
- Build and operate data pipelines and transformations
- Build infrastructure changes using infrastructure as code
- Deploy and manage Kubernetes workloads
- Design and operate role based access control and least privilege access
- Implement and support CI/CD workflows
- Monitor data platform infrastructure and pipelines
- Participate in on-call and incident response
- Support migration from legacy to modern data platform
- Troubleshoot pipeline failures using logs and metrics
- Troubleshoot reporting and analytics data pipelines
- Use AI assisted engineering tools to improve workflows
- Write Python and bash automation to reduce manual toil
- Write runbooks and platform documentation
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | BigQuery | CI/CD | Cloud IAM | CloudWatch | DBT | Data integration | Datahub | Docker | Fivetran | GCP | Git | Grafana | Helm | Incident Management | Kafka | Kubernetes | Least Privilege | Looker | MWAA | Observability | Pentaho Data Integration | Prometheus | Python | RBAC | SQL | Snowflake | Stitch | Terraform
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R11d ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R3h ago
-
Senior Staff Machine Learning Engineer, Trust USD 244K-305KA/B | A/B Testing | API Design | Agentic AI | Anomaly DetectionEmployee travel credits | Inclusion and belonging support | Remote work eligibleSenior-level Full TimeRemote - USA R9h ago
-
Associate Software Engineer – Java (AI First) USD 140K-200KAPI Design | Async Services | CI/CD | CompletableFuture | Concurrent programmingWork from anywhereMid-level Full TimeUnited States R10h ago
-
Lead Site Reliability Engineer - Ceph Storage USD 118K-231KAnsible | BlueStore tuning | Bluestore | CRUSH | CSI401k retirement plan | Generous time off | Healthcare insurance | Life insurance | Long-term disabilitySenior-level Full TimeUnited States R11h ago
-
Site Reliability Engineer - Ceph Storage USD 98K-192KAnsible | CRUSH | CSI | Ceph | CephFSGenerous time off | Healthcare insurance | Paid parental leave | Paid wellness days | Remote work optionSenior-level Full TimeUnited States R11h ago
-
Senior Data Engineer USD 105K-120KAPIs | Automated testing | CI/CD | DBT | Data Quality401k | Insurance & Health | Insurance dental | Insurance vision | Life insuranceSenior-level Full TimeRemot, USA, United States R11h ago
-
Senior Algorithms Engineer USD 144K-200KAWS | Bayesian Inference | CI/CD | Code review | Django3-day weekend | 4-day work week | Fully remote within the United States | Mentoring and training | Travel 1 to 3 times per yearSenior-level Full TimeCary, NC, United States R12h ago
-
Sr. Machine Learning Software Engineer USD 153K-206KAWS | Airflow | Amazon EC2 | Amazon S3 | Amazon SageMakerAccess to office locations | Remote work option | Travel for team meetings and cross functional projectsSenior-level Full TimeDenver, Colorado, United States; New York, … R13h ago
-
Sr. Full-Stack Engineer, AI Data Platform USD 180K-260KAWS DynamoDB | Cassandra | Cloud platform | Google Cloud | Google Cloud PlatformHybrid work scheduleSenior-level Full TimeSan Francisco Bay Area R13h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R16h ago
-
Senior AI DevEx Engineer USD 169K-220KAI-assisted coding | Application Lifecycle Management | Application lifecycle | Assisted coding | AutomationEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - Canada R19h ago
-
AI Governance | APIs | Access Management | Agentic AI | Artificial Intelligence401k retirement plan | Dental insurance | Flexible work arrangements | Fully remote | Medical insuranceSenior-level Full TimeCanada R20h ago
-
API Design | Airflow | Amazon Web Services | BigQuery | Cloud platformCollaborative remote culture | Competitive salary | Comprehensive benefits | Fully remote | High ownershipSenior-level Full TimeCanada R1d ago
-
Senior / Principal Infrastructure Engineer - ML Platform USD 278K-345KAWS | CI/CD | Cloud infrastructure | Cloud platform | Cluster managementEquity compensation | Onsite schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Mid-level Full TimeCarmel, Indiana- Hybrid OR St. Louis, … R1d ago
-
Senior AI Infrastructure Engineer, LLM/AI Platforms USD 140K-215KAWS | Airflow | Amazon SageMaker | Ansible | BatchingCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks | Paid adoption leave | Paid parental leaveSenior-level Full TimeUSA VA Remote, United States R1d ago
-
Data Engineer USD 83K-158KAngular | Continuous Delivery | Continuous integration | DevOps | Distributed SystemsMid-level Full TimeTwo Destiny Way, Westlake TX, United … R1d ago
-
Senior-level Full TimeTwo Destiny Way, Westlake TX, United … R1d ago
-
Senior Data Engineer USD 97K-185KAgile | Data Governance | Data Modeling | GitHub | Metadata ManagementOnsite work modelSenior-level Full Time2 Contra Way, Merrimack NH, United … R1d ago
-
Data Engineer (Databricks) USD 98K-202KAWS CodeBuild | Apache Spark | Azure | Azure Data | Azure Data FactoryFully remote | Up to 10% travel for client meetingsMid-level Full TimeNationwide Remote Office (US99), United States R1d ago
-
Senior-level Full TimeMansfield, MA (Remote) R1d ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R1d ago
-
.NET | Azure | Azure Data | Azure Data Explorer | Azure IoT401k match | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States R1d ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R1d ago