Databricks Data Engineer
Irving, TX, USA - 6555 North State Highway 161 (P001), United States
USD 111K-186K Senior-level Full Time
Tasks
- Analyze job failures and bottlenecks
- Build batch data pipelines
- Build streaming data pipelines
- Collaborate with analytics and data operations teams
- Document pipeline architecture and SOPs
- Enforce access policies
- Implement data security controls
- Model and validate data sets
- Monitor data pipeline health
- Optimize and maintain Databricks jobs
- Perform root cause analysis
- Resolve data quality issues
- Transform large data sets
- Troubleshoot pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Spark | Data Governance | Data Modeling | Data Pipeline Monitoring | Data Privacy | Data Quality | Data Security | Data pipeline | Databricks | Delta Lake | Encryption | Job optimization | Job orchestration | MongoDB | Oracle | Pipeline monitoring | PostgreSQL | Python | SQL
Education
N/A
Roles
Related jobs
-
Senior AI Engineer USD 149K-200KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R7h ago
-
Data Platform Engineer USD 120K-165KAWS | Apache Spark | CI/CD | Databricks | DevSecOpsHybrid work schedule | Onsite support in Fairfax VA and Springfield VA | Security clearance support for TS SCI with CI PolyMid-level Full TimeFAIRFAX, VA, United States8h ago
-
Senior Cloud Data Ops Engineer USD 97K-199KAWS RDS | Amazon Aurora | Amazon Web Services | Bash | BigQuery401k match | Childcare benefits | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeQuincy, MA, United States8h ago
-
Senior-level Full TimeHouston, TX, United States9h ago
-
C++ | Data Compression | Data Ingestion | Data Pipelines | Distributed SystemsSenior-level Full TimeSan Jose, California, United States12h ago
-
Senior Forward Deployed Engineer – AWS USD 109K-188KAWS Bedrock | Amazon Bedrock | Amazon Bedrock Agents | Amazon Web Services | Bedrock AgentsDiscretionary annual incentive program | Mentorship | Professional development programs | Travel opportunitiesSenior-level Full TimeBoise, Idaho, United States12h ago
-
Databricks Forward Deployed Engineer - GPS USD 107K-171KAI gateway | API | Airflow | Apache Spark | CI/CDMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …12h ago
-
Anthropic Forward Deployed Engineer - GPS USD 102K-171KAPI Integration | AWS | Anthropic API | Apache Airflow | Apache SparkTravelMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …12h ago
-
Snowflake Forward Deployed Engineer - GPS USD 107K-179KAPI Integration | Apache Airflow | Apache Spark | Arctic Embed | CI/CDTravel 50 PercentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …12h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 113K-188KAI gateway | APIs | AWS | Apache Airflow | Apache SparkTravel 50 PercentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …12h ago
-
Senior Snowflake Forward Deployed Engineer - GPS USD 109K-181KAPI Integration | AWS | Agentic Platforms | Airflow | Arctic EmbedTravel 50 PercentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …12h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 113K-188KAI gateway | APIs | AWS | Airflow | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …12h ago
-
Senior Software Engineer, Data Platform – USDS USD 167K-312KCI/CD | Data platform | Language Processing | Machine Learning | MeegoSenior-level Full TimeSeattle, Washington, United States12h ago
-
Computer Vision | Deep learning | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSan Jose, California, United States12h ago
-
Senior Software Engineer, Applied AI, Commerce AI USD 174K-252KAPI Design | Application Programming | Application Programming Interfaces | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA13h ago
-
AI | Adversarial Machine Learning | Data Integrity | Data Quality | Data loggingMid-level Full TimeMountain View, CA, USA13h ago
-
Manufacturing Test Development Engineer, Data Center USD 120K-172KAutomated testing | Cause analysis | Electronics testing | Functional testing | Manufacturing testCollaborate with international teams | International travel as needed | Work with global manufacturing partnersMid-level Full TimeSunnyvale, CA, USA13h ago
-
Software Engineer, Applied AI, Commerce AI USD 147K-211KAPI Design | Agile | Data Processing | Deep learning | Distributed ComputingMid-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA13h ago
-
Staff Software Engineer, DevIntel Data Warehouse USD 207K-300KC++ | Data Analysis | Data Structures | Data Warehouse | Data Warehouse DesignSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA13h ago
-
A/B | A/B Testing | Agentic Workflows | B testing | Context engineeringMid-level Full TimeMountain View, CA, USA13h ago
-
Associate Data Engineer USD 46K-111KAutomated testing | Azure DevOps | BigQuery | CI/CD | Cloud StorageCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeNashville, TN, US22h ago
-
C++ | Control Systems | Depth cameras | GPS | IMUHybrid remote option | Onsite collaborationMid-level Full TimeIrvine, CA23h ago
-
Data Ops Engineer USD 128K-170KApache Airflow | Cloud platform | Data Warehouse | DevOps | ETLDental insurance | Life insurance | Long-term disability insurance | Medical insurance | Paid time offSenior-level Full TimeMiami, Florida1d ago
-
Senior-level Full TimeSanta Ana, CA, US1d ago
-
AI Inference Engineer - Model Optimization & Deployment USD 205K-303KAccuracy evaluation | BF16 | C++ | CUDA | CUDA kernelsSenior-level Full TimeFoster City, CA1d ago