Senior Data Engineer - Databricks (No Sponsorship Available)
Indianapolis Intech 6640 Intech Blvd Suite 300, United States
USD 164K-209K (estimate) Senior-level Full Time
Tasks
- Automate CI/CD pipelines for data workflows
- Design and implement monitoring solutions
- Develop data pipelines
- Implement Delta Lake
- Integrate Databricks with Azure services
- Maintain data pipelines
- Monitor and optimize Databricks clusters
- Support data governance with Unity Catalog
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Log Analytics | Azure Monitor | Azure Pipelines | Azure Synapse | CI/CD | Cluster performance | Cluster performance optimization | Data Factory | Data Governance | Data Lake Storage | Data Pipelines | Databricks | Delta Lake | Log Analytics | Performance optimization | PySpark | Python | SQL | Scala | Snowflake | Unity Catalog | Workflow Orchestration
Education
Roles
Related jobs
-
Senior-level Full TimeHuntsville, United States8h ago
-
Senior Data Engineer USD 165K-184KAWS | Apache NiFi | Apache Spark | Data Modeling | Data PipelinesSenior-level Full TimeHuntsville, United States8h ago
-
Agile | Amazon Web Services | Apache Hive | Apache Spark | Apache ZeppelinMid-level ContractPortland, United States8h ago
-
Apache Flink | Apache Hive | Apache Kafka | Apache Spark | Apache ZookeeperSenior-level ContractPortland, United States8h ago
-
Amazon DynamoDB | Apache Hive | Java | NoSQL | Object-OrientedSenior-level ContractBeaverton, United States8h ago
-
Security Data Engineer USD 128K-214KAI | API Integration | API scaling | Anomaly Detection | Automated MonitoringDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-VA-Herndon8h ago
-
Data Engineer USD 94K-157KAWS | Air-gapped | Air-gapped environments | Bash | CRISP-DMHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Arlington, USA-Remote Work8h ago
-
Palantir MSS Developer / Engineer USD 84K-140KData Engineering | Data Modeling | Data Pipelines | Data Visualization | ELTMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …8h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Apache Spark | Artificial Intelligence | Data Modeling | Data PipelinesDiscretionary annual incentive program | Mentorship | Professional development | Travel opportunitySenior-level Full TimeRosslyn, Virginia, United States8h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States9h ago
-
Software Engineer, Search, AI/ML USD 147K-210KC++ | Data Governance | Data Governance Framework | Data Management | Data PrivacyMid-level Full TimeCambridge, MA, USA10h ago
-
Software Engineer, AI/ML, Google Research USD 147K-210KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Language ProcessingMid-level Full TimeMountain View, CA, USA10h ago
-
Software Engineer III, Infrastructure, Infra Bigtable USD 147K-210KAsynchronous processing | Back-end | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …10h ago
-
Senior Software Engineer, Infrastructure, Infra Bigtable USD 174K-252KAsynchronous processing | Backend Services | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …10h ago
-
C++ | Cloud Computing | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA10h ago
-
Senior Software Engineer, Map Ads Machine Learning USD 174K-252KAds serving | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA10h ago
-
Algorithms | Artificial Intelligence | C++ | Code Quality | Data StorageSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Systems Yield Engineer, Quantum AI USD 132K-189KCryogenic testing | Data Analysis | Data Visualization | Electrical Noise Analysis | Electrical noiseMid-level Full TimeGoleta, CA, USA10h ago
-
ANSYS | ANSYS APDL | AVL Excite | Computational Fluid Dynamics | Design optimizationMid-level Full TimeColumbus, IN, United States12h ago
-
C# | Git | JTAG | Logic analyzer | MicrocontrollersEntry-level Full TimeHillsboro, OR, US13h ago
-
AI/ML Engineer - Automation/Robotics USD 180K-200KAlgorithms | Azure Machine Learning | Data Structures | Diffusion Models | Fine Tuning401k retirement plan | Flexible spending account | Medical, dental & vision coverage | Paid time off | Parental leaveSenior-level Full TimeRedmond, WA16h ago
-
Data Engineer USD 79K-147KAccess Control | Auditing | Backup and Recovery | Bash | Caching401k match | Dental insurance | Education assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimeHighlands Ranch, CO, US17h ago
-
AWS | Algorithms | Azure | Cloud Native | Data LineageMid-level Full TimeAustin; Sunnyvale17h ago
-
Senior Machine Learning Engineer USD 149K-224KAIOps | Cloud MLOps | Cloud deployment | Data Analysis | Data Visualization401k match | Career growth opportunities | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States17h ago
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R17h ago