Senior Data Engineer - EDA Datacenter Analytics and Observability
US, CA, Santa Clara, United States
USD 184K-356K Senior-level Full Time
Tasks
- Build batch and streaming workflows
- Build ingestion pipelines for metrics logs traces telemetry
- Collaborate with data scientists and analysts on requirements
- Define data retention aggregation and enrichment strategies
- Design data pipelines
- Implement data quality checks and monitoring
- Improve data discoverability and documentation
- Ingest transform and curate observability data
- Integrate observability tools into unified datasets
- Model and organize datasets for analysis and forecasting
- Optimize pipeline scalability reliability and performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Batch Processing | Data Modeling | Data Quality | Data Validation | Elasticsearch | Grafana | Kafka | OpenSearch | Prometheus | Python | SQL | Schema Design | Streaming | Time Series
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior AI Engineer USD 149K-200KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R2h ago
-
Data Platform Engineer USD 120K-165KAWS | Apache Spark | CI/CD | Databricks | DevSecOpsHybrid work schedule | Onsite support in Fairfax VA and Springfield VA | Security clearance support for TS SCI with CI PolyMid-level Full TimeFAIRFAX, VA, United States3h ago
-
Senior Cloud Data Ops Engineer USD 97K-199KAWS RDS | Amazon Aurora | Amazon Web Services | Bash | BigQuery401k match | Childcare benefits | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeQuincy, MA, United States3h ago
-
Senior-level Full TimeHouston, TX, United States4h ago
-
C++ | Data Compression | Data Ingestion | Data Pipelines | Distributed SystemsSenior-level Full TimeSan Jose, California, United States6h ago
-
Senior Forward Deployed Engineer – AWS USD 109K-188KAWS Bedrock | Amazon Bedrock | Amazon Bedrock Agents | Amazon Web Services | Bedrock AgentsDiscretionary annual incentive program | Mentorship | Professional development programs | Travel opportunitiesSenior-level Full TimeBoise, Idaho, United States6h ago
-
Databricks Forward Deployed Engineer - GPS USD 107K-171KAI gateway | API | Airflow | Apache Spark | CI/CDMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Anthropic Forward Deployed Engineer - GPS USD 102K-171KAPI Integration | AWS | Anthropic API | Apache Airflow | Apache SparkTravelMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Snowflake Forward Deployed Engineer - GPS USD 107K-179KAPI Integration | Apache Airflow | Apache Spark | Arctic Embed | CI/CDTravel 50 PercentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 113K-188KAI gateway | APIs | AWS | Apache Airflow | Apache SparkTravel 50 PercentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Senior Snowflake Forward Deployed Engineer - GPS USD 109K-181KAPI Integration | AWS | Agentic Platforms | Airflow | Arctic EmbedTravel 50 PercentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 113K-188KAI gateway | APIs | AWS | Airflow | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Senior Software Engineer, Data Platform – USDS USD 167K-312KCI/CD | Data platform | Language Processing | Machine Learning | MeegoSenior-level Full TimeSeattle, Washington, United States7h ago
-
Computer Vision | Deep learning | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSan Jose, California, United States7h ago
-
Senior Software Engineer, Applied AI, Commerce AI USD 174K-252KAPI Design | Application Programming | Application Programming Interfaces | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
AI | Adversarial Machine Learning | Data Integrity | Data Quality | Data loggingMid-level Full TimeMountain View, CA, USA8h ago
-
Manufacturing Test Development Engineer, Data Center USD 120K-172KAutomated testing | Cause analysis | Electronics testing | Functional testing | Manufacturing testCollaborate with international teams | International travel as needed | Work with global manufacturing partnersMid-level Full TimeSunnyvale, CA, USA8h ago
-
Software Engineer, Applied AI, Commerce AI USD 147K-211KAPI Design | Agile | Data Processing | Deep learning | Distributed ComputingMid-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
Staff Software Engineer, DevIntel Data Warehouse USD 207K-300KC++ | Data Analysis | Data Structures | Data Warehouse | Data Warehouse DesignSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA8h ago
-
A/B | A/B Testing | Agentic Workflows | B testing | Context engineeringMid-level Full TimeMountain View, CA, USA8h ago
-
Associate Data Engineer USD 46K-111KAutomated testing | Azure DevOps | BigQuery | CI/CD | Cloud StorageCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeNashville, TN, US17h ago
-
C++ | Control Systems | Depth cameras | GPS | IMUHybrid remote option | Onsite collaborationMid-level Full TimeIrvine, CA18h ago
-
Data Ops Engineer USD 128K-170KApache Airflow | Cloud platform | Data Warehouse | DevOps | ETLDental insurance | Life insurance | Long-term disability insurance | Medical insurance | Paid time offSenior-level Full TimeMiami, Florida19h ago
-
Senior-level Full TimeSanta Ana, CA, US19h ago
-
AI Inference Engineer - Model Optimization & Deployment USD 205K-303KAccuracy evaluation | BF16 | C++ | CUDA | CUDA kernelsSenior-level Full TimeFoster City, CA19h ago