Staff Software Engineer, Data Platform
Tasks
- Build ingestion layer
- Build self serve pipeline tooling
- Build transformation and compute frameworks
- Conduct design reviews standards and documentation
- Define analytics engineering handoff
- Design stream processing infrastructure
- Implement PII patterns tooling
- Implement data masking retention access control
- Implement lineage cataloging and discovery
- Land data into Snowflake
- Mentor team
- Operate ingestion layer
- Operate quality and observability layer
- Own data orchestration platform
- Own data platform architecture
- Schedule retries backfills
- Set technical direction
- Support multi region residency requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Airbyte | Amazon Redshift | Apache Airflow | Azure | BigQuery | CDC | DBT | Dagster | Data Governance | Data Lineage | Data Quality | Data Residency | Data Retention | Databricks | Debezium | Fivetran | Flink | Google Cloud | Kafka | Kubernetes | Observability | Orchestration | PII masking | Pulumi | Python | SQL | Schema evolution | Snowflake | Spark Streaming | Stream processing | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R14h ago
-
Senior Data Engineer (Data Architecture) USD 105K-135KAPIs | AWS Glue | Airflow | Azure Data | Azure Data Factory401k matching | Dental insurance | Extended holiday break | Flexible schedules | Life insuranceSenior-level Full TimeRemote, United States R15h ago
-
Data Engineer, Hardware Reliability (Starlink) USD 135K-185KBash | C# | C++ | Concurrency | Data InfrastructureExtended hours and weekends | Onsite work required | Travel up to 10%Mid-level Full TimeBastrop, TX R16h ago
-
Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R16h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Airflow | Anomaly DetectionSenior-level Full TimeNew York R16h ago
-
Sr. Staff Software Engineer, Big Data Platform USD 177K-364KAWS | Apache Flink | Apache Presto | Apache Spark | Data ProcessingIn office collaboration 1 to 2 times per quarterSenior-level Full TimePalo Alto; Seattle, WA; New York, … R16h ago
-
Change Management | Cloud Data | Cloud data warehousing | DBT | Data EngineeringHybrid work scheduleEntry-level Full TimeSan Francisco, CA, United States R17h ago
-
Software Engineer I, Perception (New Grad) USD 56K-56KATRT? NLP | Adaptive thresholding | Blender | C++ | CentroidingEntry-level Full TimeDenver, CO or Long Beach, CA R18h ago
-
Senior Software Engineer, Data Platform USD 193K-290KAccess Control | Airbyte | Amazon Redshift | Amazon Web Services | Anomaly DetectionSenior-level Full TimeNew York R18h ago
-
Senior Software Engineer, Data Platform USD 193K-290KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R18h ago
-
Senior Data Engineer USD 155K-165KAI tools | AWS | Airbyte | Airflow | Alerting401k match | Dental insurance | Employee resource groups | Holiday pay | Infertility coverageSenior-level Full TimeRemote - US R19h ago
-
DevOps Engineer, Data & AI Platform USD 144K-180KAWS | Apache Airflow | Apache Kafka | Apache Spark | Bash401k match | Backup care | Dental insurance | Disability insurance | Employee resource groupsMid-level Full TimeUnited States R19h ago
-
Senior Staff Machine Learning Engineer, Post Training USD 248K-310KData Processing | Fine Tuning | GPU Inference | Kernel development | LLM Fine-tuningSenior-level Full TimeRemote - USA R19h ago
-
Senior Engineer, Data USD 140K-161KAWS | AWS Lambda | Airflow | Amazon S3 | CI/CD401k match | Dental insurance | Employee discounts | Flexible schedule | HSA contributionSenior-level Full TimeUnited States R19h ago
-
AI Engineer USD 223K-259KAgent Orchestration | Agent systems | Async | CI/CD | Capacity Planning401k | Dental insurance | Disability insurance | Flexible spending accounts | Flexible time offMid-level Full TimeRemote (Washington D.C., Atlanta, San Francisco) R19h ago
-
Data Analyst 3- AI Solutions USD 84K-115KAI Agents | Amazon Web Services | Artificial Intelligence | Azure | Data PipelinesSenior-level Full TimeRemote, US R20h ago
-
Senior Data Engineer USD 109K-164KAccess Control | Agile | Azure | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Fully remote | Health spending account | Life insuranceSenior-level Full TimeRaleigh, North Carolina, USA R21h ago
-
Junior-Mid Level GCP Data Engineer USD 76K-80KBigQuery | Cloud Composer | Cloud Dataflow | Cloud Storage | Cloud platform401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilityEntry-level ContractChandler, Arizona, USA R21h ago
-
Jr-Mid Level GCP Data Engineer USD 76K-80KApache Flink | BigQuery | Cloud Composer | Cloud Storage | Cloud platform401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractPhoenix, Arizona, USA R21h ago
-
ML Engineer, I - MLOps Framework USD 96K-135KAWS SageMaker | CI/CD | Debugging | Infrastructure as Code | Logging100 percent paid medical dental vision premiums | 401k employer match | Bonus | Disability insurance | Flexible scheduleEntry-level Full TimeRemote - US R21h ago
-
Mid-level Full TimeBoston, MA R21h ago
-
A/B | A/B Testing | AI Safety | B testing | Data Pipelines401k | Community resource groups | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeRemote - United States R21h ago
-
Sr. Embedded Engineer I, Edge Capture (6813) USD 140K-150KARM | Battery systems | C# | C++ | CSI Camera401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insurance | Paid time offSenior-level Full TimeHybrid - Reston, VA R22h ago
-
Behavior Cloning | C++ | CUDA | Collision Avoidance | ControlHybrid work policySenior-level Full TimeSunnyvale R22h ago
-
Staff Full Stack AI Engineer CAD 145K-175K.NET | AI Evaluation | AWS | Agentic Workflows | AutoGPT401k matching | Company lunches | Company outings | Continuing education | Flexible PTOSenior-level Full TimeAtlanta, Charlotte, Denver, New York, Remote … R22h ago