Distinguished Software Engineer (Big Data & AI)
Tasks
- Architect and scale DLP data platform
- Build real time data ingestion with Kafka and Pub Sub
- Define data platform technical roadmap
- Deploy and monitor machine learning models with Triton
- Design and implement big data ingestion and processing
- Design scalable data models
- Develop ETL and ELT batch and real time pipelines
- Establish SLOs for mission critical service
- Implement MLOps model training and deployment pipelines
- Implement observability, monitoring, and alerting
- Improve data platform performance bottlenecks
- Mentor staff and principal engineers
- Optimize BigQuery datasets with partitioning and clustering
- Select and implement SQL and NoSQL persistence
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Apache Spark | BigQuery | Cassandra | Cloud platform | Data Streaming | Dataflow | ELT | ETL | GKE | Google Cloud | Google Cloud Platform | Kafka | Kubeflow | MLOps | Machine Learning | MongoDB | Monitoring | NVIDIA Triton | NoSQL | Observability | Pub/Sub | SLOs | SQL | Spanner | Vertex AI
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Senior Databricks Platform Engineer USD 140K-165KAWS | Active Directory | Apache Hive | Apache Spark | Audit LoggingSenior-level Full TimeArlington, VA, United States4h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R4h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R4h ago
-
Data Architect USD 112K-181KData Modeling | Database Administration | Database Design | Microsoft Office | SQLSenior-level Full TimeAtlanta, GA, United States4h ago
-
Lead Business Intelligence Engineer USD 100K-150KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeWestchester, IL, United States4h ago
-
Artificial Intelligence | Assessment | Curriculum Development | Live coding | Machine LearningEntry-level Part TimeRemote, United States R4h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5h ago
-
Senior-level ContractRaleigh, United States6h ago
-
AI Agents | AI Governance | Artificial Intelligence | Cybersecurity compliance | Enterprise SearchHybrid work | Local residency requirementEntry-level ContractAustin, United States6h ago
-
AI Platform Engineer USD 108K-215KAutogen | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key VaultMid-level Full TimeBelmont, NC, United States7h ago
-
AI Platform Engineer USD 108K-215KAI Agents | Agent Frameworks | Autogen | Azure Data | Azure Data LakeMid-level Full TimeBelmont, NC, United States7h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York7h ago
-
Project GenAI Engineer III USD 113K-188KAWS | Bedrock | Generative AI | Machine LearningMentorship | Onsite work | Professional development | Travel up to 25%Senior-level Full TimeArlington/Rosslyn, Virginia, United States7h ago
-
Amazon Web Services | Artificial Intelligence | Artificial Intelligence Architecture | Cloud Architecture | Cloud platformMentorship | Professional development | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …7h ago
-
Analytics | Artificial Intelligence | Cloud Computing | Data Architecture | Data GovernanceCompetitive benefits package | Mentorship | Professional development | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …7h ago
-
AWS | Artificial Intelligence | Cloud platform | Data Architecture | Data GovernanceTravel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …7h ago
-
Project Lead Data Engineer III USD 119K-198KBTEQ | Database Administration | Patch Management | Performance Tuning | Query OptimizationSenior-level Full TimeSacramento, California, United States7h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 77K-176KAPI Development | Agile | Backend Development | Cloud Computing | Data Preparation401k | Employee discounts | Employee referral rewards | Flexible work schedule | Health savings accountMid-level Full TimeQuantico, VA, US R9h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R9h ago
-
AI | API Integration | Agent Orchestration | Automation frameworks | Bias MitigationSenior-level Full TimeAustin, TX | Menlo Park, CA …9h ago
-
Computer Vision Engineer USD 170K-251K3D Modeling | AR/VR | Computer Graphics | Computer Vision | Data AnalysisSenior-level Full TimeBurlingame, CA9h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …9h ago
-
AI/HPC Network Performance Engineer USD 147K-226KAI Training | Alerting | Auto-remediation | C++ | Configuration ManagementOncall rotationSenior-level Full TimeMenlo Park, CA9h ago