Senior Data Engineer
USD 140K-165K (estimate) Senior-level Full Time
Tasks
- Build and operate data pipelines
- Collaborate with trading and risk teams on data needs
- Define target data architecture
- Develop data products and real time decision APIs
- Enforce security compliance encryption least privilege
- Ensure data quality, lineage, observability
- Establish coding, testing, CI/CD standards
- Implement data governance catalog access controls
- Implement monitoring alerting runbooks on call
- Integrate external and vendor data safely
- Introduce CDC schema evolution stream batch unification patterns
- Lead incident reviews and architectural forums
- Mentor engineers and develop learning plans
- Optimize cloud spend and capacity planning
- Own platform capacity performance reliability cost
Perks/Benefits
Skills/Tech-stack
API Design | AWS | Access Control | Airflow | Apache Spark | Application Insights | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Key Vault | Azure Monitor | Azure Synapse | Azure Synapse Analytics | BDD | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lakehouse | Data Lineage | Data Pipelines | Data Quality | Delta Lake | Delta Lake on ADLS | DevOps | Event Driven | Event Hubs | Event-driven architecture | Flink | GRPC | Gas trading | GitHub Actions | Grafana | Great Expectations | Iceberg | Infrastructure as Code | Integration Testing | Java | Kafka | Kafka Streams | Key Vault | Log Analytics | Materialized views | Natural Gas | Natural gas trading | Observability | Pandas | Playwright | Power trading | Prometheus | Purview | Python | REST | Requests | SQL | Scala | Scrapy | Selenium | Series data | Snowflake | Snowpipe | Snowpipe Streaming | Streaming | Streams and Tasks | Synapse Analytics | TDD | Terraform | Time Series | Time Series Data | Unit Testing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Pipelines401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Health insuranceMid-level Full TimeWork From Home, United States R2h ago
-
Senior-level Full TimeAnnapolis Junction, MD4h ago
-
AWS | Agentic AI | Angular | CI/CD | DatabricksHybrid work | Technical mentorshipSenior-level Full TimeNormal, United States6h ago
-
Sr. Data Engineer USD 108K-158KAWS | Apache Spark | Automated testing | Azure Event | Azure Event Hubs401k matching | Dental insurance | Disability insurance | Educational growth | Employee discount programSenior-level Full TimeNew York-TONAWANDA7h ago
-
Artificial Intelligence | Data Modeling | Data Pipelines | Data Quality | Data Visualization401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York7h ago
-
Backup and Restore | Blob Storage | Cluster communication | Cluster management | Crash diagnosticsSenior-level Full TimeSan Jose, California, United States7h ago
-
AWS | AWS SDK | Amazon MSK | Apache Kafka | Generative AISenior-level Full TimeNew York, New York, United States8h ago
-
Production Engineer USD 178K-200KApache | Apache Spark | Application Programming | Application Programming Interfaces | C++Entry-level Full TimeMenlo Park, CA8h ago
-
Research Engineer - MSL FAIR Foundations USD 117K-173KBenchmarking | Code review | Data Pipelines | Distributed Systems | Language ModelEntry-level Full TimeMenlo Park, CA8h ago
-
Senior Software Engineer, AI/ML, Search Growth USD 174K-252KA/B | A/B Testing | B testing | Deep learning | Information RetrievalSenior-level Full TimeMountain View, CA, USA8h ago
-
Staff Software Engineer, Agentic Data and Evals USD 207K-300KC++ | CSS | Cloud | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Data Engineer USD 155K-180KAWS | Agile | Alerting | Azure | Bash401k savings plan | Dental insurance | Employee assistance plan | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States10h ago
-
Data Engineer USD 118K-125KAWS | Agile | Apache Spark | Azure | Bash401k savings plan with profit sharing | Commuter parking tax savings | Employee assistance program | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States10h ago
-
Senior GenAI Engineer USD 119K-258KAI Foundry | AI Search | API Management | AWS Bedrock | Active DirectorySenior-level Full TimeMiami, FL, US, 3313112h ago
-
Software Engineer, Applied AI USD 130K-500KData Pipelines | Data Quality | Evaluation Frameworks | Experimental Design | GoDental insurance | Equity grant | Free Equinox Membership | Health insurance | Housing bonusMid-level Full TimeSan Francisco13h ago
-
Staff Machine Learning Engineer USD 188K-221KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R16h ago
-
Staff Software Engineer, Data & AI USD 183K-214KAWS | Airflow | Analytics | Artificial Intelligence | BI AnalyticsSenior-level Full TimeCA - San Francisco; WA - …17h ago
-
ASR | Automatic Speech Recognition | CTC | Data Augmentation | Knowledge Distillation401k matching | Annual offsites | Dental insurance | Free snacks and drinks | Health insuranceSenior-level Full TimeSan Francisco, CA18h ago
-
Application Software Engineer, Data USD 150K-225KAngular | C# | CI/CD | Continuous integration | DeploymentSenior-level Full TimeStarbase, TX19h ago
-
Deployed Engineer (Denver) USD 150K-250KAI Agent | AI agent deployment | AWS | Agent deployment | Agent-based401-k plan | Dental coverage | Flexible vacation | Meals on in office days | Medical coverageSenior-level Full TimeDenver, CO19h ago
-
Deployed Engineer (Las Vegas) USD 150K-250KAWS | Azure | Docker | Failure handling | GCP401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimeLas Vegas, NV19h ago
-
Deployed Engineer (Phoenix) USD 150K-250KAWS | Agent Frameworks | Azure | Cloud Computing | Containers401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimePhoenix, AZ19h ago
-
Full Stack AI Developer USD 146K-222KAgile | Angular | Auto-tagging | CI/CD | Chunking401k | Education reimbursement program | Flexible schedule | Hybrid schedule | MentorshipSenior-level Full TimeLivermore, CA, United States R19h ago
-
Senior Data Engineer USD 239K-271KAirflow | Alerting | Amazon Redshift | Automated testing | Cost OptimizationFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R19h ago
-
AI Security | API Security | Adversarial Machine Learning | Data exfiltration | Evasion TechniquesLife insurance | Mental health support | Private medical coverageMid-level Full TimePortland, Oregon, United States19h ago