Senior Staff Data Engineer, Databricks (R5492)
Tasks
- Build Delta Lake ingestion with batch and streaming
- Build Silver layer cleansing standardization deduplication and conformance
- Build and maintain CI CD pipelines for data assets
- Create data quality checks for business meaning and integrity
- Define reusable ingestion and transformation patterns
- Design and build ingestion pipelines
- Implement data classification and segregation controls
- Implement secure Databricks platform constructs
- Maintain data documentation and transformation notes
- Own Bronze layer ingestion and recoverable loading
- Partner with analytics engineers for governed data for modeling
- Quarantine and route problematic datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Spark | Batch Ingestion | CDC | CI/CD | Data Classification | Data Governance | Data Modeling | Data Quality | Data Security | Databricks | Delta Lake | Delta Lake Tables | Dimensional Modeling | PySpark | SQL | Spark SQL | Streaming Ingestion | Testing | Unity Catalog | Version control | Workflow Orchestration
Education
N/A
Roles
Data Engineer | Engineer | Senior Data Engineer | Staff Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R20d ago
-
API | Amazon Web Services | Apache Airflow | Apache NiFi | BitbucketDental insurance | Discounts on courses and universities | Fully remote | Health insurance | Meal allowanceMid-level Full TimeBrazil R4h ago
-
Staff Analytics Engineer, Databricks (R5493) USD 182K-250KBI Integration | DBT | Databricks | Delta Lake | Dimension TableSenior-level Full TimeRemote R5h ago
-
Staff Data Scientist, Marketing USD 175K-200KAWS | AdTech Algorithms | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeMontevideo, Uruguay (remote) R5h ago
-
Staff Data Scientist, Marketing USD 175K-200KAd Ranking | Amazon Web Services | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeAntigua, Guatemala (remote) R5h ago
-
Staff Applied Scientist, AdTech USD 175K-200KAWS | Collaborative Filtering | Deep learning | Funnel Optimization | Language ProcessingRemote-first teamSenior-level Full TimePanama City, Panama (remote) R5h ago
-
Staff Applied Scientist, AdTech USD 175K-200KAd Ranking | Ad Ranking Algorithms | Amazon Web Services | Collaborative Filtering | Content-Based FilteringSenior-level Full TimeMontevideo, Uruguay (remote) R5h ago
-
Staff Applied Scientist, AdTech CLP 49980K-58800KAWS | Collaborative Filtering | Content-Based Filtering | Content-based | Funnel OptimizationDiversity, equity, and inclusion focus | Global team | Remote-first cultureSenior-level Full TimeValparaíso, Chile (remote) R5h ago
-
Staff Applied Scientist, AdTech USD 175K-200KAWS | Amazon Web Services | Collaborative Filtering | Content-Based Filtering | Content-basedDiversity and inclusion | Remote-first cultureSenior-level Full TimeLima, Peru (remote) R5h ago
-
Staff Applied Scientist, AdTech USD 175K-200KAWS Cloud | Collaborative Filtering | Content-Based Recommendation | Content-based | Funnel OptimizationDiversity and inclusion | Equal employment opportunity | Remote-first cultureSenior-level Full TimeAlajuela, Costa Rica (remote); Cartago, Costa … R5h ago
-
Staff Applied Scientist, AdTech MXN 934K-1200KAWS | Collaborative Filtering | Content-Based Recommendation | Content-based | Funnel OptimizationDiversity and inclusion culture | Remote-first teamSenior-level Full TimeCiudad de Mexico, Mexico (remote); Guadalajara, … R5h ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | Ad Ranking | Collaborative Filtering | Content-Based Filtering | Content-basedDiversity and inclusion focus | Remote-first cultureSenior-level Full TimePanama City, Panama (remote) R5h ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | AdTech Algorithms | Funnel Optimization | LTV modeling | Machine LearningSenior-level Full TimeMontevideo, Uruguay (remote) R5h ago
-
Lead Applied Scientist, Marketing CLP 49980K-58800KAWS | Collaborative Filtering | Content-Based Recommendations | Content-based | Funnel OptimizationDiversity, equity, and inclusion culture | Remote-first teamSenior-level Full TimeValparaíso, Chile (remote) R5h ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | Adtech | Collaborative Filtering | Content-Based Recommendation | Content-basedDiversity and inclusion focus | Remote-first work environmentSenior-level Full TimeLima, Peru (remote) R5h ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | Ad Ranking | Collaborative Filtering | Content-Based Filtering | Content-basedDiversity & inclusion culture | Remote-first teamSenior-level Full TimeCuenca, Ecuador (remote); Quito, Ecuador (remote) R5h ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | Ad Ranking | Ad Ranking Algorithms | Collaborative Filtering | Content-Based FilteringDiversity and inclusion initiatives | Remote-first cultureSenior-level Full TimeAntigua, Guatemala (remote) R5h ago
-
Lead Applied Scientist, Marketing COP 72000K-73200KAWS | Adtech | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeBarranquilla, Colombia (remote); Bogota, Colombia (remote); … R5h ago
-
Lead Applied Scientist, Marketing MXN 934K-1100KAWS | Adtech | Collaborative Filtering | Content-Based Recommendation | Content-basedSenior-level Full TimeCiudad de Mexico, Mexico (remote); Guadalajara, … R5h ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | AdTech Algorithms | Collaborative Filtering | Deep learning | EmbeddingCareer growth | Diversity and inclusion focus | Remote-first cultureSenior-level Full TimeBuenos Aires, Argentina (remote); Cordoba, Argentina … R5h ago
-
Lead Applied Scientist, Marketing BRL 305K-390KAWS | AdTech Algorithms | Collaborative Filtering | Content-Based Recommendation | Content-basedSenior-level Full TimeBelo Horizonte, Brazil (remote); Brasilia, Brazil … R5h ago
-
Staff ML Engineer, Agent Training & Environments USD 250K-280KApache Kafka | CI/CD | Cloud platform | Direct Preference Optimization | Google CloudCareer growth tied to impact | Hybrid work model | Ownership and autonomySenior-level Full TimeSan Francisco Bay Area R8h ago
-
Staff Data Engineer USD 170K-230KAWS Lambda | Amazon Redshift | Apache Airflow | DBT | Data Governance401k | Commuter benefits | Flexible PTO | Health coverage | Stock option planSenior-level Full TimeRemote R10h ago
-
Senior-level Full TimeRemote R11h ago
-
Staff Data Engineer CAD 152K-237KAI tools | Attribution | Consent Management | Customer Data | Customer Data PlatformSenior-level Full TimeCanada R13h ago