Azure Databrick with Anaplan
Tasks
- Build Delta Lake medallion architecture bronze silver gold
- Build scalable data ingestion workflows
- Collaborate on data architecture and design patterns
- Conduct code reviews for coding standards and data quality
- Design, develop, and optimize ETL pipelines
- Develop reusable Databricks notebooks and jobs
- Implement data governance security and access control
- Implement data transformation cleansing enrichment validation
- Integrate Databricks with Azure services
- Optimize Spark jobs performance and cost
- Orchestrate pipelines with Azure Data Factory
- Prepare technical documentation and runbooks
- Troubleshoot production issues root cause analysis
Perks/Benefits
- 401k
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid Holidays
- Paid time off
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS Gen2 | Auto Scaling | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Cleansing | Data Enrichment | Data Factory | Data Ingestion | Data Lake Storage Gen2 | Data Processing | Data Validation | Databricks Jobs | Databricks Notebooks | Delta Lake | Distributed data | Distributed data processing | ETL | Event Hubs | Git | Key Vault | Medallion Architecture | PySpark | Spark | Spark SQL | Spark clusters | Synapse Analytics
Education
N/A
Related jobs
-
Amazon Redshift | Data Modeling | Data Pipelines | ETL | ExperimentationMid-level Full TimeBellevue, Washington, USA7h ago
-
Senior Data Engineer USD 165K-216KAWS | Apache Airflow | BI Integration | CI/CD | Cloud Computing401k match | Company events | Dental insurance | Employee discount | Free swagSenior-level Full TimeBeverly Hills11h ago
-
Senior-level Full TimeChantilly, VA13h ago
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States13h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeExposure to real-world projects | Learning and development opportunities | MentorshipEntry-level InternshipBoston, MA, United States13h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States13h ago
-
AWS | Agent systems | Apache Spark | Apache Spark SQL | AzurePeriodic onsite work | Remote work option | Travel as neededSenior-level Full TimeMaryland; Virginia; Washington, D.C.13h ago
-
Senior Embedded Software Engineer USD 146K-196KARM Cortex | C# | Digital Signal | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | FSA | Flexible scheduleSenior-level Full TimeCamarillo, CA, United States14h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R14h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R15h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R15h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States16h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R16h ago
-
Senior Data Engineer (TS/SCI Clearance) USD 130K-220KData Visualization | Database performance | Database performance tuning | ETL | High PerformanceEmployee development | High employee morale | RetentionSenior-level Full TimeHuntsville, United States17h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York18h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton18h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …18h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI Integration | AWS | Airflow | Apache Spark | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …18h ago
-
Senior Software Engineer, Generative AI, Google Ads USD 174K-252KComputer Vision | Data Processing | Debugging | GenAI | Information RetrievalSenior-level Full TimeMountain View, CA, USA20h ago
-
C++ | Data Processing | Debugging | Deep learning | Few-Shot LearningSenior-level Full TimeMountain View, CA, USA20h ago
-
Software Engineer III, Generative AI, Payments Risk USD 147K-211KAgent systems | Algorithms | Analytics | Big Data | Computer VisionSenior-level Full TimeMountain View, CA, USA20h ago
-
C++ | Data Analysis | Data Processing | Deep learning | EmbeddingsSenior-level Full TimeMountain View, CA, USA20h ago
-
Apache Flume | C++ | Data Modeling | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA20h ago
-
Agentic AI Engineer USD 103K-158KAI Search | Agent Orchestration | Anthropic Claude | App Service | Autogen401k match | Flexible paid time off | Hybrid work flexibility | Medical/Dental/Vision | Paid parental leaveMid-level Full TimeGolden, CO, US21h ago
-
AWS | Agile | Airflow | Azure | CI/CDSenior-level Contract Full TimeChicago, Illinois, United States23h ago