AIML - Sr Data Engineer, DMLI
Tasks
- Build batch data pipelines
- Build data platforms
- Build streaming data pipelines
- Create training data generation pipelines
- Debug distributed pipelines
- Design scalable data pipelines
- Develop ETL/ELT processes
- Develop metadata management solutions
- Enable analytics capabilities
- Enable business intelligence capabilities
- Enable machine learning capabilities
- Implement data governance
- Implement event-driven architectures
- Implement feature engineering
- Maintain data integration solutions
- Manage data lineage
- Monitor and alert distributed pipelines
- Optimize BigQuery performance
- Optimize data modeling
- Optimize query execution
- Support ML pipelines
- Support MLOps workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Beam | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud platform | Clustering | Code review | Data Governance | Data Lineage | Data Modeling | Dataflow | ELT | ETL | Event Driven | Event-driven architecture | Feature Engineering | Google Cloud | Google Cloud Platform | MLOps | Metadata Management | Partitioning | Pub/Sub | Python | Query Optimization | Testing | Vector Search | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
Senior Software Engineer, AI/ML, AI Builder USD 174K-252KCode review | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; New York, …2h ago
-
C++ | Data Processing | Debugging | Distributed Computing | Information RetrievalHealth insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeMountain View, CA, USA2h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-210KC++ | Data Analysis | Data Processing | Data Structures | Data Structures and AlgorithmsBonus | Equity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeMountain View, CA, USA2h ago
-
AI Pipelines | APIs | Agent systems | BigQuery | CI/CDSenior-level Full TimeReston, VA, USA2h ago
-
Forward Deployed Engineer IV, GenAI, Public Sector USD 207K-300KAI Pipelines | API Integration | Agent systems | BigQuery | CI/CDSenior-level Full TimeReston, VA, USA2h ago
-
Senior Software Engineer, AI/ML Infrastructure, YouTube USD 174K-252KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSan Bruno, CA, USA2h ago
-
Senior Data & ML Ops Engineer USD 137K-206KAWS | Airflow | Amazon SageMaker | Automated retraining | Automated testingHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeBoston, Massachusetts, US, 022106h ago
-
Accessibility API | Algorithms | Analytics | App SDK | Asynchronous programmingSenior-level Full TimeKansas City, MO, USA7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible remote work | Laid-back atmosphereMid-level Full TimeSeattle, WA, USA8h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Diverse and inclusive workplace | Portfolio support | Remote-friendly environmentMid-level Full TimeChicago, IL, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Career growth | Competitive compensation | Remote-friendly cultureMid-level Full TimeLong Beach, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeSalt Lake City, UT, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management approachMid-level Full TimeMountain View, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Remote workMid-level Full TimeSunnyvale, CA, USA8h ago
-
AI Data | Bash | Cloud infrastructure | Data Ingestion | Data Ingestion PipelinesAsynchronous culture | Flexible team environment | Remote-friendlyMid-level Full TimeBerkeley, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Collaborative team environment | Flexible, hands-off management | Remote-friendly work environmentMid-level Full TimeFremont, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid back environment | Remote-friendlyMid-level Full TimeSanta Monica, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Career growth | Flexible management | Impactful missionMid-level Full TimeIrvine, CA, USA8h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible management approach | Remote/distributed work | Supportive teamMid-level Full TimeHuntsville, AL, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Remote-first environmentMid-level Full TimeTampa, FL, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Friendly work environment | Portfolio supportMid-level Full TimeNewark, NJ, USA8h ago
-
Bash | Cloud platform | Data Processing | Data Processing Pipelines | Dataset EngineeringMid-level Full TimePhiladelphia, PA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Portfolio supportMid-level Full TimeNew Haven, CT, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial team | Friendly laid-back atmosphere | Portfolio and LinkedIn sharing | Remote friendly distributed settingMid-level Full TimeTacoma, WA, USA8h ago