Data Engineer (Databricks)
Tasks
- Build CI/CD pipelines
- Define data platform architecture
- Design Lakehouse architectures
- Develop PySpark jobs
- Develop migration roadmaps
- Develop models with Unity Catalog
- Enable Delta sharing
- Establish data governance standards
- Implement Databricks Apps
- Implement data masking
- Implement role-based access controls
- Integrate real-time streaming data
- Orchestrate data workflows with Airflow
Perks/Benefits
- Company holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision insurance
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Access Control | Airflow | CI/CD | Data Governance | Data masking | Databricks | Databricks Apps | Delta Sharing | Lakehouse | PySpark | Role-Based Access | Role-Based Access Control | Streaming integration | Unity Catalog
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Senior-level Full TimeOrlando, FL, United States5h ago
-
Data Visualization & Integration Specialist USD 115K-150KAPI Integration | Bill of Materials | Data Governance | ETL | ExcelHybrid work scheduleMid-level Full TimeMarietta, GA, United States7h ago
-
Senior-level Full TimeHoboken, NJ, United States8h ago
-
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions100 percent on siteSenior-level ContractMc Lean, United States9h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R18h ago
-
Senior-level Full TimeMountain View, CA20h ago
-
Principal / Sr Principal Data Analytics Engineer USD 98K-184KAgile | CI/CD | Data Governance | Data Modeling | Data MonitoringCompany-Paid Holidays | Disability insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeFLME229, United States22h ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R22h ago
-
Senior Machine Learning Engineer USD 134K-168KData Drift | Databricks | Ethical AI | Feature Engineering | KubernetesSenior-level Full TimeNew York, NY, United States22h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R22h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R22h ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R22h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Ingestion | Data Lineage | Data ModelingRemote workMid-level Full TimeUnited States - Remote R22h ago
-
AI Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code review100 percent remote | Benefits | Career growth potentialMid-level Full TimeUnited States - Remote R22h ago
-
Senior-level Full TimeUnited States - Remote R22h ago
-
Senior Data Integration Operations Engineerr USD 130K-189KAWS | Access Control | Automation | Azure | Best practices24 7 availability on rotating basis | Documentation and knowledge management support | Hybrid work schedule | Rotating on-callSenior-level Full TimeNU Boston Campus, United States22h ago
-
AI Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageMid-level Full TimeUnited States - Remote R22h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States1d ago
-
Machine Learning Engineer USD 124K-170KAWS Bedrock | AWS Fargate | AWS Lambda | AWS Step Functions | Amazon ECSCareer development opportunities | Equal employment opportunityMid-level Full TimePlano, Texas, United States1d ago
-
Software Engineer (AI/ML) USD 170K-240KAPI Integration | Access Control | CSS | Information security | JavaScript401k contribution | Career counseling | Career development and training | Health, dental and vision coverage | Holiday paySenior-level Full TimeFort Meade, MD1d ago
-
Staff AI Engineer USD 140K-210KAPI Development | AWS | Access Management | Bedrock AgentCore | CI/CD401k | All-hands meetings | Dental insurance | Employee equity program | Health insuranceSenior-level Full TimeNew York City1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | AMD Xilinx toolchain | AMD/Xilinx SoC | BashHybrid work options | Remote work optionsSenior-level Full TimeNew Haven, CT1d ago
-
Lead Data Engineer USD 120K-187KAgile | Apache Spark | Azure | CI/CD | Data Governance401k matching | Disability insurance | Employee assistance program | Healthcare coverage | Life insuranceSenior-level Full TimeRichmond, Virginia, United States R1d ago
-
Senior Analyst, Business Strategy and Analytics USD 95K-135KData Governance | Data Integrity | Data Mining | Data Validation | Microsoft Access401k match | Education assistance | Employee discounts | Family & fertility benefits | Free virtual health careSenior-level Full TimeColumbus, OH, United States2d ago