Databricks Data Engineer
Home Office: Tysons, VA, United States
USD 113K-188K Senior-level Full Time
Tasks
- Apply data governance security lineage and compliance standards
- Collaborate with cross-functional teams and stakeholders
- Design, build, and maintain scalable data pipelines
- Develop batch and streaming data workflows
- Document pipelines datasets data models and engineering decisions
- Implement data validation and data quality checks
- Perform code reviews and resolve data issues
- Translate requirements into data engineering designs and workflows
- Troubleshoot data pipeline failures and performance issues
- Write optimize and maintain Python PySpark and SQL code
Perks/Benefits
Skills/Tech-stack
Access Control | Apache Spark | CI/CD | Cloud Storage | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Validation | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Orchestration | PySpark | Python | SQL | Streaming | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Active Learning | Calibration | Causal Inference | Constrained optimization | Contextual BanditsSenior-level Full TimeAustin, TX6h ago
-
Staff Machine Learning Engineer USD 165K-236KClass imbalance | Docker | Error Analysis | Feature Engineering | Feature Labeling401k | Bonus | Equity | Generous vacation time | Medical/Dental/Vision insuranceSenior-level Full TimeRemote USA R7h ago
-
Dynamic Scheduler DSP Algorithm Engineer USD 125K-175KCombinatorial Optimization | Convex Optimization | MATLAB | Optimization Solvers | PythonMid-level Full TimeLanham, Maryland, United States8h ago
-
AWS | Azure | CI/CD | Container Networking | Containers401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R8h ago
-
Senior Database Engineer USD 130K-150KAWS | AWS CDK | AWS CloudFormation | Access Control | Amazon AuroraSenior-level Full TimeLas Vegas, Nevada, United States; Seattle, … R10h ago
-
Software Engineer, Fulfillment Core Services USD 128K-160KAPI Integration | AWS | Buildkite | CI/CD | CircleCI401k company match | Childcare benefits | Commuter benefits | Dental insurance | Family building benefitsEntry-level Full TimeSeattle, WA R11h ago
-
Staff Data Engineer USD 170K-195KAWS | AWS Glue | Airbyte | Amazon EMR | Amazon S3Diversity and inclusion focus | No work visa sponsorship | Reasonable accommodationsSenior-level Full TimeSan Jose, California, United States12h ago
-
Software Engineer, Data Infrastructure USD 155K-185KAWS | Access Control | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeMountain View, CA12h ago
-
Junior AI Engineer - Onsite USD 54K-60KAPI | Anthropic | Docker | JSON | JavaScriptOnsite work locationEntry-level Full TimeGrand Rapids, Michigan12h ago
-
AI Engineer - On Site USD 65K-87KAPI | Automation | Billing automation | Compliance Automation | ConnectwiseEntry-level Full TimeGrand Rapids, Michigan12h ago
-
Data Engineer II (Remote US) USD 94K-118KAlerting | BigQuery | Clustering | Common table expressions | Cost Management401k matching | Annual learning budget | Dental insurance | Employee resource groups | Health insuranceMid-level Full TimeRemote - U.S. R12h ago
-
Cloud Solutions Engineer (Data & Platform) USD 130K-181KAWS | Ansible | Apache Spark | CI/CD | Configuration ManagementMid-level Full TimeFalls Church, Virginia13h ago
-
BESS | Battery Energy Storage | Battery Energy Storage Systems | Battery sizing | Controls engineering401k company match | Company holidays | Medical, dental, and vision insurance | Paid time off | Professional development and growth opportunitiesSenior-level Full TimeAlpharetta, Georgia, United States; Atlanta; Miami, …14h ago
-
Senior Machine Learning Engineer USD 150K-225KAIOps | AWS | Azure | Data Analysis | Data Visualization401k match | Career growth opportunities | Dental insurance | Employee resource groups | Flexible paid time offSenior-level Full TimeRemote, United States14h ago
-
Senior Data Engineer USD 120K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States14h ago
-
Lead AI Engineer-Machine Learning USD 110K-198KAWS | Agile | Azure | CI/CD | Cloud platform401k match | Dental insurance | Disability insurance | Growth opportunities | Holiday paySenior-level Full TimeParsippany, NJ, United States14h ago
-
Senior Data Engineer (AWS, Azure, GCP) USD 90K-200KAWS | Ab Initio | Alteryx | Amazon Redshift | Apache Spark401k matching | Disability insurance | Employee stipend benefits | Fertility coverage | Generous PTOSenior-level Full TimeRichmond, VA, United States R15h ago
-
Data Engineer (AWS, Azure, GCP) USD 90K-200KAWS Lambda | Amazon EMR | Aurora | BigQuery | C#401k matching | Disability insurance | Employer Stipend | Fertility coverage | Health coverageMid-level Full TimeAtlanta, GA, United States R15h ago
-
Lead AI Engineer USD 180K-280KAWS SageMaker | Azure Machine Learning | CI/CD | ColBERT | DockerChildcare benefits | Onsite gym | Tuition assistanceSenior-level Full TimeQuincy, MA, United States15h ago
-
Senior Cloud Data Ops Engineer USD 140K-180KAWS | Amazon Aurora | Amazon RDS | Bash | BigQuery401k match | Bonus eligibility | Childcare benefits | Gym access | Insurance coverageSenior-level Full TimeQuincy, MA, United States15h ago
-
Senior-level ContractBeaverton, OR, US16h ago
-
Data Engineer USD 90K-130KBusiness Objects | Change Management | Data Governance | Data Lineage | Data ModelingMid-level Full TimeNashville, TN, United States17h ago
-
API | Agile Software Development | Agile software | Apache Kafka | Application developmentSenior-level Full TimeDearborn, United States17h ago
-
Data Engineer CAD 100K-170KAWS | Apache Airflow | Azure | BigQuery | Cloud Computing401k | Asynchronous work culture | Autonomy | Company paid life insurance | Disability coverageMid-level Full TimeRemote - US or Canada R17h ago
-
Senior-level ContractGreensboro, North Carolina, USA17h ago