Senior Databricks Engineer
Tasks
- Architect data lakes
- Architect data warehouses
- Build data pipelines
- Conduct code reviews
- Configure Unity catalog
- Create data products
- Create documentation
- Deliver data
- Design data pipelines
- Develop Delta Live Tables
- Develop medallion architecture
- Implement data governance best practices
- Implement data quality best practices
- Implement data security best practices
- Ingest structured data
- Ingest unstructured data
- Maintain data pipelines
- Optimize SQL Warehouse
- Perform cluster configuration
- Share knowledge
- Support batch processing
- Support real-time data ingestion
- Transform data
- Tune data pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Azure Databricks | Batch Processing | Cluster configuration | Data Governance | Data Ingestion | Data Lakes | Data Migration | Data Products | Data Quality | Data Security | Data Warehouses | Delta Live Tables | Delta Live) | Medallion Architecture | Performance Tuning | PySpark | Real Time | Real-time Data | Real-time data ingestion | SQL | Unity Catalog
Education
Related jobs
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R10h ago
-
Senior Machine Learning Engineer, Operations Research USD 173K-218KCombinatorial Optimization | Deep learning | Keras | Machine Learning | Mathematical ProgrammingAnnual refresh grants | Equity grant | Flexible work policy | Remote workSenior-level Full TimeUnited States - Remote R11h ago
-
Machine Learning & Game Tech Architect USD 186K-257KAPI Design | C# | C++ | Game engines | Go401k matching | Dental insurance | Flexible schedule | Flexible working hours | Health insuranceSenior-level Full TimeBoston, MA, United States R11h ago
-
Senior Data Engineer MXN 1040K-1300KAWS | Amazon RDS | Apache Spark | CI/CD | Cloud SecurityEquipment stipend | Flexible PTO | Laptop and tools | Learning and development stipend | Paid certifications examsSenior-level Full TimeMEXICO R13h ago
-
AWS RDS | AWS Security | Amazon Web Services | Apache Spark | AutomationEquipment and office stipend | Flexible PTO | Laptop and tools | Learning and development stipend | Paid exams and certificationsSenior-level Full TimeARGENTINA R13h ago
-
Senior Data Engineer BRL 304K-370KAWS Lambda | Amazon RDS | Amazon S3 | Amazon Web Services | Apache SparkEquipment stipend | Flexible PTO | Learning and development stipend | Paid certifications exams | Professional development planSenior-level Full TimeBRAZIL R13h ago
-
Senior AI Engineer PHP 100K-160KAI Pipelines | Agent Builder | Artifact Registry | Automated retraining | BigQuerySenior-level Full TimeMéxico (Remote) R14h ago
-
Senior Data Analytics Engineer USD 145K-180KAWS Glue | AWS S3 | Ad Spend | Amazon Athena | Amazon RedshiftPaid time off | Remote workSenior-level Full TimeRemote job R14h ago
-
Data Engineer (remote) USD 85K-100KAgile | Apache Hive | Apache Impala | Apache Spark | Artificial Intelligence401k match | Employee assistance program | Flexible schedule | Health insurance | Life insuranceMid-level Full TimeWork From Home, United States R15h ago
-
Analytics Engineer USD 130K-155KAmazon Redshift | BigQuery | CI/CD | DBT | Data Governance401k match | Dental coverage | HSA contribution | Learning and development stipend | Mental health dayMid-level Full TimeRemote R15h ago
-
Senior Analytics Engineer USD 140K-170KAWS | Airflow | BigQuery | DBT | Data Validation401k match | Disability Leave | Family building benefits | Health benefits | Learning stipendSenior-level Full TimeGameChanger Remote - US R15h ago
-
Airflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCareer development | Company-provided equipment | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia R16h ago
-
Azure DataOps - H/F EUR 44K-50KAWS | Agile | Ansible | Azure | Azure DevOpsDisability support services | Employee share ownership | Equipment bonus | Health insurance | Mobility supportEntry-level Full TimeParis, IDF, France R16h ago
-
ML / Data Analyst BGN 44K-52KData Classification | Data Pipelines | Data Quality | Machine Learning | Regular ExpressionsAdditional medical insurance | Employee Assistance Program (EAP) | Flexible working hours | Food vouchers | Free access to LinkedIn Learning platformMid-level Full TimeSofia, 23, Bulgaria R18h ago
-
Ansible | Backup and Recovery | Barman | Bash | Cause analysisAI assisted tooling support | Flexible location in Canada | Healthcare benefits | Inclusive work culture | Professional developmentSenior-level Full TimeCanada R19h ago
-
Backend Engineer AI Integration EUR 55K-60KAWS | Agent systems | Async Programming | Azure | CI/CDExtra day off for birthday | Flexible compensation platform | Gym wellness membership | Language courses | Meal vouchersMid-level Full TimeBarcelona, CT, Spain R19h ago
-
APIs | Azure Data | Azure Data Factory | Data Factory | Data Ingestion2 days remote work | 3 days on-site | CDI contract | Hybrid workMid-level Full TimeParis, France R21h ago
-
Tech Lead Cloud & Data Engineer (F/H) EUR 50K-65KAgile | Amazon Redshift | Amazon S3 | Azure | Azure DataEmployee stock ownership plan | Health insurance | Maternity Leave Supplement | Paid vacation bonus | Training opportunitiesSenior-level Full TimeLille, Hauts-de-France, France R21h ago
-
Agile | Apache Hadoop | Apache Spark | CI/CD | Cloud ComputingContinuous learning programs | Employee representative council | Health insurance | Meal vouchers | Profit sharingMid-level Full TimeParis, IDF, France R22h ago
-
Data Engineer confirmé(e) - Assurance - Lille EUR 38K-48KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | CI/CDEmployee representative committee | Health insurance | Holiday bonus | Meal vouchers | Profit sharingMid-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R22h ago
-
Agile | Apache Hadoop | Apache Hive | Apache Kafka | Apache SparkEmployee representative council | Health insurance | Meal vouchers | Profit sharing | Referral bonusMid-level Full TimeParis, IDF, France R23h ago
-
Data Engineer USD 118K-145KAWS | Apache Airflow | Apache Spark | Azure | BigQuery401k plan | Dental insurance | Health insurance | Remote work | Unlimited PTOMid-level Full TimeNew York, NY R1d ago
-
Sr. Embedded Detection Analyst USD 170K-205KAI tools | Alert Correlation | Cause analysis | Data Analysis | Detection engineeringSenior-level Full TimeRemote - USA R1d ago
-
Airflow | Amazon Redshift | Amazon SageMaker | BigQuery | CI/CDFlexible hours | Remote workSenior-level Full TimeSouth Africa - Remote R1d ago
-
Software Engineer INR 1200K-1400KAWS | Apache Flink | Apache Spark | Data Modeling | Data WarehousingHybrid work | Remote workMid-level Full TimeRemote (IND), India R1d ago