Data Engineer
Tasks
- Apply medallion architecture principles
- Build data ingestion pipelines
- Collaborate with stakeholders to translate requirements
- Design raw refined curated data models
- Develop ETL/ELT workflows
- Implement data validation and quality checks
- Implement open lakehouse architecture patterns
- Maintain data transformation and delivery pipelines
- Manage metadata and cataloging
- Orchestrate Agile sprint planning and delivery
- Prepare transform and harmonize ERP data
- Set up data monitoring and lineage
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Agile | Apache Spark | BigLake | BigQuery | CI/CD | Cloud Storage | Data Cataloging | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data pipeline | Data pipeline orchestration | Dataflow | DevOps | ELT | ETL | GCP Storage | Infrastructure as Code | Metadata Management | Pipeline Orchestration | Python | SQL | Snowflake | “as-code”
Education
N/A
Roles
Related jobs
-
Lead Data Architect (Semantic Layer) USD 192K-264KAccess Control | Change Management | Conformed Dimensions | Data Governance | Data Lineage401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States8h ago
-
Staff Engineer - Machine Learning USD 211K-261KAWS | Airflow | Batching | Caching | Event DrivenAdoption leave | Commuter benefits | Dental insurance | Disability insurance | Flexible PTOSenior-level Full TimeSan Mateo, CA, United States10h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Cloud platform | Data Analysis | Data Visualization401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R11h ago
-
Mid-level Full TimeNashville, TN, United States13h ago
-
Mid-level Full TimeNew York, Canada14h ago
-
AI Engineer - Automotive AI Systems USD 180K-269KAdversarial Robustness | BLEU | Bias analysis | CI/CD | Dataset curationSenior-level Full TimeAuburn Hills, MI, United States14h ago
-
Software Engineer [Multiple Positions Available] USD 180K-215KAWS | Apache Kafka | Classification | Cohort Analysis | DockerBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site wellness centersSenior-level Full TimeWilmington, DE, United States15h ago
-
Data Scientist, Innovation Hub USD 108K-108KAzure | CI | CI/CD | Integration Testing | PythonCareer growth | Healthcare | Merit increases | On-site childcare | PTOMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd15h ago
-
CI/CD | Data Modeling | Data Observability | Data Validation | Data profiling401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimePrinceton15h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | Data parallelismSenior-level Full TimeSunnyvale, CA17h ago
-
Software Engineer, Systems ML USD 141K-208KBenchmarking | C plus plus | CUDA | Compute utilization | Distributed SystemsSenior-level Full TimeSunnyvale, CA | Menlo Park, CA17h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud AI USD 147K-211KAudio generation | C++ | Code review | Data Processing | Data StorageSenior-level Full TimeSunnyvale, CA, USA17h ago
-
Software Engineer III, AI/ML, Keywordless Search Ads USD 147K-211KC++ | Data Processing | Debugging | Generative AI | Information RetrievalSenior-level Full TimeMountain View, CA, USA17h ago
-
Software Engineer III, AI/ML, Google Fi USD 147K-211KAlgorithms | Data Processing | Data Structures | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, USA; San Francisco, …17h ago
-
Business Data Scientist, Applied Machine Learning, GCS USD 138K-198KA/B | A/B Testing | B testing | Causal Inference | Data DriftMid-level Full TimeMountain View, CA, USA; New York, …17h ago
-
Database querying | Deep learning | Graph Databases | Language Processing | Machine LearningMid-level Full TimeNew York, NY, USA; Mountain View, …17h ago
-
Access Control | Alerting | Batch Processing | Data Governance | Data ModelingSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA17h ago
-
Software Engineer III, AI/ML, YouTube USD 147K-211KC++ | Data Processing | Debugging | Language Processing | Machine LearningSenior-level Full TimeMountain View, CA, USA; San Bruno, …17h ago
-
Algorithms | Artificial Intelligence | C plus plus | C# | Data StorageManagement support | Mentorship | On the job onboarding trainingSenior-level Full TimeSunnyvale, CA, USA17h ago
-
Software Engineer III, Gemini Enterprise App, Cloud AI USD 147K-211KAccess Control | Batch Processing | Data Engineering | Data Governance | Data ModelingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA17h ago
-
Senior Data Engineer, GTM USD 156K-227KAI Agents | Alerting | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeMountain View, CA, USA; Chicago, IL, …17h ago
-
Staff Software Engineer, Gemini Enterprise App, Cloud AI USD 207K-301KBatch pipelines | C++ | Data Privacy | Data Structures | Data WarehousingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA17h ago
-
Junior Data Engineer USD 48K-54KAzure | Azure Data | Azure Data Services | CI/CD | DBTHealth and wellness programs | Inclusive culture | Medical dental and disability benefits | Retirement savings programEntry-level Full TimeAtlanta, GA, US, 3033821h ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R23h ago
-
Agentic AI Engineer (Boston, Hybrid) USD 319K-350KAI orchestration | AWS | Autogen | Azure | CrewAIEquity | Health benefits | Hybrid workMid-level Full TimeBoston R1d ago