Data Engineer - Azure, Databricks
Chicago, IL, US
USD 112K-148K Senior-level Full Time
Tasks
- Automate platform operations
- Collaborate with engineering teams
- Execute controlled production changes
- Implement permanent fixes
- Improve job performance
- Maintain SOPs
- Maintain knowledge articles
- Maintain runbooks
- Monitor SLAs
- Monitor job performance
- Monitor platform costs
- Optimize Delta Lake
- Optimize Spark workloads
- Participate in change management
- Participate in incident management
- Participate in problem management
- Perform root cause analysis
- Provide production support
- Troubleshoot ingestion failures
- Troubleshoot performance issues
- Troubleshoot scheduling failures
- Troubleshoot schema drift
- Troubleshoot transformation failures
- Tune Databricks clusters
Perks/Benefits
- Company-Paid Holidays
- Dental coverage
- Disability insurance
- Employee assistance program
- Life insurance
- Medical coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
- Vision coverage
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | Azure Monitor | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage Gen2 | Databricks | Delta Lake | Delta Lake Optimization | Git | Key Vault | Log Analytics | PySpark | SQL | SQL Database | Synapse Analytics | Unity Catalog
Education
N/A
Language: en
Views:
2
Clicks:
0
Saves: 0
Related jobs
-
Entry-level Full Time InternshipWoodridge, IL, United States4h ago
-
Senior AI Engineer / Data Scientist USD 110K-170KApache Spark | Automated Deployment | CI/CD | Databricks | DockerRemote workSenior-level ContractChandler, United States6h ago
-
IT Data Engineer III USD 117K-124KANSI X12 | ARM Templates | Azure Data | Azure Data Factory | Azure Data LakeProfessional development | Remote workSenior-level Full TimeUS - Remote R8h ago
-
Junior AI Engineer USD 100K-120KCI/CD | Document processing | Embeddings | Faiss | Function CallingEntry-level Full TimeNew York, New York, United States9h ago
-
Data Engineer, Product Analytics USD 184K-235KAI tools | Agent Orchestration | Bias Mitigation | C# | C++Career growthSenior-level Full TimeBellevue, WA | Redmond, WA | … R9h ago
-
Data Engineer I - Salesforce Data 360 USD 92K-123KAPIs | Access Control | Data Engineering | Data Governance | Data Modeling401k match | Employee resource groups | Flexible PTO | Healthcare premium coverage | Onboarding programMid-level Full TimeMorrisville, NC, US, 2756013h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-510KContinuous Improvement | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeNew York, New York16h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-435KDeep learning | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts16h ago
-
Senior Analytics Engineer USD 140K-175KBusiness Intelligence | DBT | Data Modeling | Data Pipelines | Data WarehousingDental insurance | Equity compensation | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Fullstack - Data Platform (Autonomy) USD 170K-210KAWS | Amazon RDS | Database Indexing | Django | DocumentDBDental insurance | Equity compensation | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Senior Embedded Software Engineer USD 160K-200KC# | C++ | CI/CD | Embedded Systems | GitDental insurance | Medical insurance | Paid time off | Travel opportunities | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Principal Software Engineer, DBS Redshift USD 220K-311KArchitecture Design | Cloud Computing | Code review | Database Management | Distributed Systems401k matching | Employee assistance program | Health insurance | Paid time off | Parental leaveSenior-level Full TimeEast Palo Alto, California, USA20h ago
-
AWS | Azure | Azure DevOps | CI/CD | Cloud platform401k plan | Commuter benefits | Dental insurance | Employee assistance programs | Employee stock purchase planSenior-level Full TimeUS - Grand Island, NY - …20h ago
-
Senior Principal Engineer Software (Embedded) USD 122K-184KAgile | Atlassian | Authentication | Bash | C#Relocation assistance | TravelSenior-level Full TimeFLME228, United States20h ago
-
Senior-level Full Time100 New Millennium Way, Bldg 1, …20h ago
-
Senior AI/ML Engineer USD 107K-216KAWS | Analytics | Async I/O | Backpressure | CI/CDEducational assistance | Emotional well-being support | Employee match program | Health care coverage | Learning resourcesSenior-level Full Time245 Summer St, Boston MA, United … R20h ago
-
DataOps Engineer USD 62K-141KAWS | AWS Glue | AWS Lambda | AWS Managed Workflows for Apache Airflow | AWS S3Dependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, VA, McLean (8283 Greensboro Dr, …20h ago
-
Senior Business Intelligence and Analytics Engineer USD 100K-155KAirflow | BigQuery | Command Line | DBT | Data Catalog401k matching | Company offsite | Dental insurance | Employee wellness | Free therapySenior-level Full TimeUS - Remote R21h ago
-
Machine Learning Engineer USD 150K-180KBatching | Deep learning | Embeddings | GPU | Inference Optimization401k matching | Company sponsored offsite | Employee wellness | Free therapy | Hardware or software stipendMid-level Full TimeUS - Remote R21h ago
-
Associate Data Scientist - Originations USD 85K-115KData pipeline | Machine Learning | PyTorch | Python | SQL401k match | Company equipment provided | Company in person events | Company-paid medical, dental & vision | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R21h ago
-
Software Engineer, Data Infrastructure USD 216K-300KApache Spark | C++ | Context Optimization | Data Modeling | Distributed SystemsCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning & development stipend | Retirement benefitsSenior-level Full TimeNew York, NY; Washington, DC21h ago
-
Senior Software Engineer, Data Engineering USD 220K-240KAWS Athena | AWS EC2 | AWS EMR | AWS Glue | AWS Lambda401k match | Backup child elder and pet care support | Chime Days paid days off | Community organization time support | Family planning tool benefitsSenior-level Full TimeSan Francisco, CA, USA R22h ago
-
Analytics Engineer, Talent Aquisition USD 166K-220KAPI Connector | Access Control | Audit trails | Business Intelligence | Cloud DataMid-level Full TimeBoston, Massachusetts, United States22h ago
-
Analytics Engineer, Talent Aquisition USD 166K-220KAPI | Access Control | Audit Logging | Cloud Data | Cloud Data WarehouseMid-level Full TimeSeattle, Washington, United States22h ago
-
Analytics Engineer, Talent Aquisition USD 166K-220KAPI | Access Control | Business Intelligence | Cloud Data | Cloud Data WarehouseHealth benefits | Recovery BenefitsMid-level Full TimeCosta Mesa, California, United States22h ago