Data Engineer
Tasks
- Build and operate batch and streaming data pipelines
- Build automated ETL/ELT pipelines
- Collaborate to deliver reusable data products
- Design develop maintain Databricks based data pipelines
- Design maintain data models schemas tables and medallion architecture
- Develop production data processing solutions
- Document data models and pipeline designs
- Implement data protection access control auditing and governance
- Implement data quality checks automated testing monitoring lineage and metadata management
- Manage Databricks notebooks jobs workflows clusters and compute
- Optimize Spark workloads and Databricks resources
- Support Databricks deployments with CI CD infrastructure as code and source control
- Support data discovery governance and access controls with Unity Catalog
- Troubleshoot Databricks workloads data pipelines storage and production data services
Perks/Benefits
- 401k employer match
- Federal holidays off
- Flexible PTO
- Flexible spending account
- Health, dental, and vision insurance
- Life insurance
- Long-term disability
- Paid Cloud Developer Accounts
- Professional development
- Referral bonuses
- Short-term disability
Skills/Tech-stack
AWS | Airflow | Apache Spark | Azure | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Security | Databricks | Delta Lake | Docker | Docker Compose | ELT | ETL | Google Cloud | Infrastructure as Code | Kafka | Kinesis | Kubernetes | Lakehouse Architecture | Metadata Management | Monitoring | PySpark | Python | SQL | Source Control | Spark Structured Streaming | Structured Streaming | Unity Catalog | “as-code”
Education
Roles
Related jobs
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Bias Mitigation | C# | C++Entry-level Full TimeMenlo Park, CA7h ago
-
Customer and Product Solutions Engineer, GenAI USD 127K-182KC++ | CSS | Cloud Platforms | Data Analysis | Gemini APIEquity compensation | Health insurance | Paid time off | Retirement benefitsMid-level Full TimeSunnyvale, CA, USA7h ago
-
AI Algorithms | APIs | Backend Services | C++ | Cloud infrastructureMid-level Full TimeSunnyvale, CA, USA7h ago
-
Senior Software Engineer, Generative AI, Search Health USD 174K-252KA/B | A/B Testing | B testing | Computer Vision | Data AnalysisSenior-level Full TimeMountain View, CA, USA7h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-197KASIC design | Code review | High Performance | High-Performance Design | Learning algorithmsMid-level Full TimeSunnyvale, CA, USA7h ago
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States12h ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States12h ago
-
A Star | AutoWare | Behavior planning | C Sharp | C#Senior-level Full TimeUnited States, Washington, Redmond17h ago
-
Acceptance Testing | Cause analysis | Data Analysis | Electrical troubleshooting | IMUSecurity screening required | Travel opportunitiesSenior-level Full TimeUnited States, Washington, Redmond17h ago
-
Senior-level Full TimeUnited States18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois18h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA18h ago
-
Senior Spacecraft Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k match | Dental insurance | EV charging | FSA | Flexible PTOSenior-level Full TimeEl Segundo, California, United States20h ago
-
Spacecraft Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | EV charging | Flexible PTO | Gym Wellness Reimbursement | HSA employer matchEntry-level Full TimeEl Segundo, California, United States20h ago
-
Senior Data Scientist - Ontology USD 128K-170KCypher | Data integration | Data profiling | Description logics | Entity ResolutionSenior-level Full TimeOffice Location or Remote - USA R20h ago
-
Machine Learning Engineer I, Network USD 151K-189KClassification | Data Pipelines | Deep learning | Embedding Models | Experiment tracking401k match | Commuting support | Fertility benefits | Flexible PTO | Free lunchSenior-level Full TimeSan Francisco, CA20h ago
-
Data Analysis | Machine Learning | Model Predictive | Model-Predictive Control | Optimal ControlSenior-level Full TimeSeattle20h ago
-
Applied LLM Systems Engineer USD 191K-253KAccess Management | Agent systems | Auditability | Caching | Cloud infrastructureSenior-level Full TimeCosta Mesa, California, United States20h ago
-
Lead Machine Learning Engineer USD 183K-215KAmazon ECS | Apache Airflow | Apache Spark | CUDA | Cloud ComputingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States20h ago
-
Senior Data Science Engineer USD 160K-175KAPI Development | Apache Airflow | Apache Spark | CI/CD | DBTFlexible work optionsSenior-level Full TimeRemote (United States) R21h ago
-
Accounting Analytics & BI Engineer USD 220K-270KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working hours | Generous vacation | Health benefits | Hybrid work policy | Optional equity donation matchingMid-level Full TimeSan Francisco, CA R21h ago
-
Senior Data Engineer USD 100K-120KAWS | Agile | Azure | Cloud Architecture | Data Lake401k employer match | Career development | Dental insurance | Employee discounts | Employer Disability BenefitsSenior-level Full TimeBurnsville, MN, US21h ago