Distinguished Software Engineer (Big Data & AI)
Tasks
- Architect and scale DLP data platform
- Build real time data ingestion with Kafka and Pub Sub
- Define data platform technical roadmap
- Deploy and monitor machine learning models with Triton
- Design and implement big data ingestion and processing
- Design scalable data models
- Develop ETL and ELT batch and real time pipelines
- Establish SLOs for mission critical service
- Implement MLOps model training and deployment pipelines
- Implement observability, monitoring, and alerting
- Improve data platform performance bottlenecks
- Mentor staff and principal engineers
- Optimize BigQuery datasets with partitioning and clustering
- Select and implement SQL and NoSQL persistence
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Apache Spark | BigQuery | Cassandra | Cloud platform | Data Streaming | Dataflow | ELT | ETL | GKE | Google Cloud | Google Cloud Platform | Kafka | Kubeflow | MLOps | Machine Learning | MongoDB | Monitoring | NVIDIA Triton | NoSQL | Observability | Pub/Sub | SLOs | SQL | Spanner | Vertex AI
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R3d ago
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R10h ago
-
Senior Data Engineer USD 90K-110KAWS | Agile | Apache NiFi | Data Architecture | Data ModelingAutonomy | Flexible working hours | Global employee assistance programme | Online training videos | Teambuilding eventsSenior-level Full TimeNew York, United States11h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R12h ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R14h ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R15h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States17h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD18h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon18h ago
-
AI-assisted software development | AWS | Agentic AI | Azure | Cloud ComputingSenior-level Full TimeUSA-VA-Herndon18h ago
-
Analytics Engineer USD 115K-150KAgile | Azure DevOps | CI/CD | DBT | Data GovernanceAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountMid-level Full TimeHouston, Texas | Tulsa, Oklahoma | …19h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …19h ago
-
Data & Analytics Specialist USD 87K-135KAPI Integration | Alteryx | DAX | JavaScript | Power AppsAdoption Assistance | Educational assistance | Flexible spending account | Health savings account | Life insuranceMid-level Full TimeWichita, Kansas19h ago
-
Data Platform & Engineering Specialist USD 100K-130KAWS | Amazon Kinesis | Azure | Azure Event | Azure Event HubsDental insurance | Educational assistance | Flexible spending accounts | Health insurance | Health savings accountsMid-level Full TimeLincoln, Nebraska19h ago
-
Machine Learning Leader - Optical Solutions USD 180K-300KAnomaly Detection | Data analytics | Image Processing | Java | Machine LearningAdoption Assistance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeFremont, California19h ago
-
Process and Analytics Engineer USD 105K-140KAgile | Anomaly Detection | Asset Framework | HYSYS | HYSYS OnlineDental insurance | Disability insurance | Educational assistance | Flexible spending account | Health insuranceMid-level Full TimeWichita, Kansas19h ago
-
AI Architect USD 134K-237KAI Search | AI Security | API Gateway | API Integration | AWS BedrockAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountsSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …19h ago
-
CV/NLP/Multimodal LLM Machine Learning Engineer Graduate (TikTok-Trust and Safety) - 2026 Start (PhD) USD 136K-246KActive Learning | Computer Vision | Content Classification | Data-Driven Strategy | Data-drivenEntry-level Full TimeSeattle, Washington, United States20h ago
-
Senior Finance Data Engineer / Data Analyst USD 100K-120KDAX | Dashboard Development | Data Modeling | Data Standardization | Data TransformationSenior-level Full TimeAuburn Hills, MI, United States21h ago
-
Software Engineer III, Generative AI USD 147K-211KComputer Vision | Data Processing | Debugging | Language Models | Language ProcessingSenior-level Full TimeKirkland, WA, USA21h ago
-
Staff Software Engineer, AI/ML, YouTube Ads USD 207K-301KA/B | A/B Testing | B testing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA21h ago
-
Machine Learning Engineer USD 120K-140KAI Pipelines | AI Workbench | AI endpoints | Apache Kafka | Automated testingEntry-level Full TimeDenver, Colorado, United States23h ago
-
Senior Software Engineer - Database Engineering USD 200K-287KAutomated testing | Debugging | Distributed Systems | Distributed key-value stores | Failure recoverySenior-level Full TimeUS-CA-Menlo Park1d ago
-
Solutions Architect USD 180K-247KAccount Management | Artificial Intelligence | Big Data | Cloud | Data ScienceSenior-level Full TimeArizona; California; Utah1d ago
-
Data Analyst - Forecasting and Optimization USD 124K-187KBacktesting | Deep learning | Feature Engineering | Gurobi | HiGHS401k matching | Disability insurance | Health insurance | Life insurance | Medical savings accountMid-level Full TimePhiladelphia, PA, United States1d ago