Senior Databricks Engineer
Remote, Anywhere
R
A USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Architect data lakes
- Architect data warehouses
- Build data pipelines
- Conduct code reviews
- Configure Unity catalog
- Create data products
- Create documentation
- Deliver data
- Design data pipelines
- Develop Delta Live Tables
- Develop medallion architecture
- Implement data governance best practices
- Implement data quality best practices
- Implement data security best practices
- Ingest structured data
- Ingest unstructured data
- Maintain data pipelines
- Optimize SQL Warehouse
- Perform cluster configuration
- Share knowledge
- Support batch processing
- Support real-time data ingestion
- Transform data
- Tune data pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Azure Databricks | Batch Processing | Cluster configuration | Data Governance | Data Ingestion | Data Lakes | Data Migration | Data Products | Data Quality | Data Security | Data Warehouses | Delta Live Tables | Delta Live) | Medallion Architecture | Performance Tuning | PySpark | Real Time | Real-time Data | Real-time data ingestion | SQL | Unity Catalog
Education
Related jobs
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R4h ago
-
ADLS Gen2 | Apache Spark | Auto Loader | Azure | Azure DataSenior-level Full TimeAlphaville - Barueri, BR, 06.454-000 R10h ago
-
Data Engineer PHP 1200K-1440KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Hive | Apache SparkAnnual leave | Bereavement leave | Birthday leave | Flexible work arrangement | Hybrid work arrangementSenior-level Full TimeTaguig, Metro Manila, Philippines R12h ago
-
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQueryFlexible schedule | Remote workMid-level Full TimePakistan - Remote R12h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R12h ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible schedule | Project based workSenior-level FreelanceUnited Kingdom - Remote R12h ago
-
Computer Science | MATLAB | NumPy | Pandas | PythonFlexible part-time hours | Project based workSenior-level FreelanceArgentina - Remote R12h ago
-
C# | MATLAB | NumPy | Pandas | PythonProject based workSenior-level FreelanceSpain - Remote R12h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 100K-100KMATLAB | NumPy | Pandas | Python | RPart time freelance assignments | Project based workSenior-level FreelanceFrance - Remote R12h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R12h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R12h ago
-
Senior-level FreelancePortugal - Remote R12h ago
-
Mid-level Full TimeRemote R13h ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R13h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R14h ago
-
Data Engineer - Costa Rica USD 86K-107KAWS | AWS Lambda | Azure | Data Lakes | Data WarehouseBereavement leave | Dental insurance | Disability insurance | Employee assistance program | Employee discount programMid-level Full TimeCosta Rica R19h ago
-
Senior Data Engineer USD 118K-158KAWS Redshift | Agile | Amazon EMR | Amazon S3 | Apache AirflowDental insurance | Education reimbursement | Family bonding | Flexible work hours | Health insuranceSenior-level Full TimeHeredia, Heredia, Costa Rica R19h ago
-
AWS | CI/CD | Data Governance | Data Lakehouse | Data ModelingHybrid work model | International team | Remote work option | Training programSenior-level ContractVilnius, Lithuania (Remote) R19h ago
-
Data Engineer EUR 35K-39KAWS CloudFormation | Apache Airflow | BigQuery | Cloud platform | DBTFlexible work hours | Half day Friday | Inclusive international environment | Learning and training access | Paid volunteering daysMid-level Full TimeLisbon, Lisbon, Portugal R19h ago
-
Data Engineer EUR 35K-39KAWS CloudFormation | Apache Airflow | Cloud platform | DBT | Data ModelingFlexible working hours | Half-day Fridays | Learning and development training | Remote work in Spain | Shorter working weekMid-level Full TimeMadrid, MD, Spain R19h ago
-
Data Engineer CHF 100K-146KAWS CloudFormation | Apache Airflow | Cloud platform | DBT | Data ModelingE-learning access | Flexible work hours | Friday half-day | Hybrid work | Parental leaveMid-level Full TimeChiasso, TI, Switzerland R19h ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R20h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingFlexible work environment | Open office environment | Remote work | Team building eventsSenior-level Full TimeMinnesota R20h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Team building eventsMid-level Full TimeMassachusetts R20h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeIdaho R20h ago