BI Data Engineer II
Tasks
- Build curated lakehouse datasets and analytics ready models
- Design Databricks lakehouse data pipelines
- Develop Databricks notebooks jobs and workflows
- Enable CI CD automated deployments
- Implement data validation and data quality checks
- Ingest and integrate data across systems
- Monitor troubleshoot and optimize Spark jobs
- Support Databricks platform administration
Perks/Benefits
- Fertility & adoption support
- Free beer
- Free financial coaching
- Health and wellness program and discounts
- Healthcare
- Professional development and training
- Tuition reimbursement
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | CI/CD | Data Governance | Data Quality | Data Security | Data Validation | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Python | SQL | Unity Catalog
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
C++ | Data Processing | Debugging | Distributed Computing | Information RetrievalHealth insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeMountain View, CA, USA2h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-210KC++ | Data Analysis | Data Processing | Data Structures | Data Structures and AlgorithmsBonus | Equity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeMountain View, CA, USA2h ago
-
AI Pipelines | APIs | Agent systems | BigQuery | CI/CDSenior-level Full TimeReston, VA, USA2h ago
-
Forward Deployed Engineer IV, GenAI, Public Sector USD 207K-300KAI Pipelines | API Integration | Agent systems | BigQuery | CI/CDSenior-level Full TimeReston, VA, USA2h ago
-
Senior Software Engineer, AI/ML Infrastructure, YouTube USD 174K-252KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSan Bruno, CA, USA2h ago
-
Senior Data & ML Ops Engineer USD 137K-206KAWS | Airflow | Amazon SageMaker | Automated retraining | Automated testingHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeBoston, Massachusetts, US, 022107h ago
-
Accessibility API | Algorithms | Analytics | App SDK | Asynchronous programmingSenior-level Full TimeKansas City, MO, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Flexible remote work | Laid-back atmosphereMid-level Full TimeSeattle, WA, USA8h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Diverse and inclusive workplace | Portfolio support | Remote-friendly environmentMid-level Full TimeChicago, IL, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Career growth | Competitive compensation | Remote-friendly cultureMid-level Full TimeLong Beach, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeSalt Lake City, UT, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management approachMid-level Full TimeMountain View, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid-back atmosphere | Remote workMid-level Full TimeSunnyvale, CA, USA8h ago
-
AI Data | Bash | Cloud infrastructure | Data Ingestion | Data Ingestion PipelinesAsynchronous culture | Flexible team environment | Remote-friendlyMid-level Full TimeBerkeley, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Collaborative team environment | Flexible, hands-off management | Remote-friendly work environmentMid-level Full TimeFremont, CA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Laid back environment | Remote-friendlyMid-level Full TimeSanta Monica, CA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Career growth | Flexible management | Impactful missionMid-level Full TimeIrvine, CA, USA8h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible management approach | Remote/distributed work | Supportive teamMid-level Full TimeHuntsville, AL, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Remote-first environmentMid-level Full TimeTampa, FL, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Friendly work environment | Portfolio supportMid-level Full TimeNewark, NJ, USA8h ago
-
Bash | Cloud platform | Data Processing | Data Processing Pipelines | Dataset EngineeringMid-level Full TimePhiladelphia, PA, USA8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Portfolio supportMid-level Full TimeNew Haven, CT, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial team | Friendly laid-back atmosphere | Portfolio and LinkedIn sharing | Remote friendly distributed settingMid-level Full TimeTacoma, WA, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible work environment | Impactful product mission | Remote workMid-level Full TimeColorado Springs, CO, USA8h ago